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PARTICIPATING  COMPANIES  AND  GOVERNMENT  FACILITIES 


1)  The  following  companies  and  government  agencies  participated  in  the 
Industry/Government  Work  Force  Survey: 

ARRADCOM 
PDSS  Center 
Dover,  NJ 

CECOM 

Software  Development  and  Support  Center 
Ft.  Leavenworth,  Kansas 

CECOM/CENTACS 

Software  Technology  Division 
Ft.  Monmouth,  NJ 

Control  Oata  Corp. 

40  Avenue  at  the  Common 
Shrewsbury,  NJ 

FATDS 

Software  Support  Group 
Ft.  Sill,  Oklahoma 

General  Dynamics 
Data  Systems  Division 
P.  0.  Box  748 
Fort  Worth,  Texas 

GTE  Systems 
77  A  Street 
Needham,  MA 

IBM 

Federal  Systems  Division 
Oswego,  New  York 

MICOM 

Software  Support  Center 
Redstone  Arsenal,  Alabama 
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SofTech 

460  Totten  Pond  Road 
Waltham,  MA 

Sperry  Uni vac 
766  Shrewsbury  Ave. 

Tinton  Falls,  NJ 

TRW 

One  Space  Park 
Redondo  Beach,  CA 

following  co*panias  participated  In  the  Industrial 

Control  Oata  Corp. 

40  Avenue  at  the  Cownon 
Shrewsbury,  NJ 

General  Dynamics 
Oata  Systems  Oivision 
P.0.  Box  748 
Fort  Worth,  Texas 

GTE  Systems 
77  A  Street 

Needham,  MA 

IBM 

Federal  Systems  Division 
Oswego,  New  York 

Singer  Kearfott 
1150  McBride  Avenue 
West  Paterson,  NJ 

Sperry  Uni vac 
766  Shrewsbury  Ave. 

Tinton  Falls,  NO 

TRW 

One  Space  Park 
Redondo  Beach,  CA 
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INDUSTRY/GOVERNMENT  WORK  FORCE  SURVEY 

•  Letter  to  Survey  Administrator 

•  Guidelines  for  survey  distribution 

•  Survey 


*Ada  is  a  trademark  of  the  Department  of  Defense  (Ada  Joint  Program  Office) 


March  l,  1982 


Dear  Survey  Administrator: 

The  Center  for  Tactical  Computer  Systems,  U.S.  Army  Communication- 
Electronics  Command  (CECOM) ,  Fort  Monmouth,  NJ ,  is  sponsoring  a  study  to 
identify  effective  approaches  for  the  use  of  Ada  in  designing  and 
developing  embedded  systems  software.  This  effort  is  part  of  the  Army 
Ada  Language  Program,  the  first  phase  of  a  major  software  technology  R&D 
initiative  intended  to  introduce  a  new  and  more  effective  method  for 
software  development  and  maintenance. 

As  part  of  this  study,  SofTech,  Inc.,  has  been  awarded  a  contract 
to  conduct  a  survey  of  the  industrial  and  government  work  force  to 
determine  generic  job  categories  among  embedded  systems  personnel.  The 
survey  results  will  be  used  to  assist  in  the  formulation  of  Ada  training 
requirements.  Your  agreement  to  participate  in  this  survey  is  vital  to 
CECOM  in  establishing  Ada  training  criteria  which  will  accurately  reflect 
the  needs  of  industry  and  government. 

This  packet  contains  a  set  of  questionnaires  for  distribution  to 
your  staff.  These  are  designed  to  gather  information  about  job 
categories  for  embedded  systems  personnel.  We  have  included  some 
guidelines  for  survey  distribution  which  we  hope  will  be  helpful.  The 
surveys  have  been  structured  to  require  approximately  thirty  minutes  of 
any  respondent's  time.  Please  return  the  completed  surveys  to  SofTech  by 
March  26,  1982. 

Your  participation  is  a  key  element  in  assuring  the  success  of  this 
survey  and  we  are  most  appreciative  of  your  efforts  on  our  behalf.  CECOM 
is  committed  to  transferring  the  Ada  technology  in  the  most  efficient  and 
timely  way  to  the  Ada  user  community.  The  published  results  of  this 
survey  will  be  sent  to  you  as  soon  as  they  come  available. 

Thank  you  for  your  time  and  effort. 

Very  truly  yours, 

Joseph  Keman 
Chief,  Software  Technology 
Development  Division 
CENTACS 
CECOM 
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INDUSTRY/GOVERNMENT  WORK  FORCE  SURVEY 


GUIDELINES  FOR  SURVEY  DISTRIBUTION 


This  survey  is  intended  for  personnel  involved  with  embedded 
computer  system  software.  The  survey  should  be  distributed  to  as 
broad  a  sample  of  job  titles  and  responsibilities  as  possible 
within  your  organization.  It  is  the  intent  that  the  results  of 
this  survey  are  representative  of  individuals  involved  with  each 
phase  of  the  software  life  cycle  (i.e.,  design,  coding, 
maintenance ,  management ) . 


Briefly  explain  to  each  manager  or  to  the  individual  respondent: 

-  The  general  purpose  of  the  survey. 

-  The  expected  completion  time  of  thirty  minutes. 

-  The  selected  procedure  for  questionnaire  return. 


Questionnaire  return  alternatives: 

-  Individual  respondents  can  mail  their  completed  question¬ 

naires  directly  to  SofTech,  Inc.  Postpaid  Return  envelope 
suitable  for  this  alternative  will  be  orovided  by  SofTech, 
Inc. 


Survey  Administrators  can  collect  respondents'  completed 
questionnaires  and  mail  to  SofTech,  Inc.,  460  Totten  Pond 
Road,  Waltham,  MA  02154. 


If  you  have  any  questions  regarding  this  survey  effort,  please 
contact : 

Karen  Sather 
Survey  Coordinator 
SofTech,  Inc. 

617/890-6900,  Ext.  187 


Hear  Survey  Participants: 
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Formulation  of  Policy  _  n.  Other  (explai 


Preparing  version  audits 
Quality  Assurance 

Preparing  temporary  (proposed) 
engineering  change  reports/requests 


Documenting  code 


16.  Which  of  the  following  programming  languages  have  you  studied  or  used?  Please  check  all  that  apply, 
a.  JOVIAL  j.  ALGOL  s.  SNOBOL 


8.  M- S/Chapin  Chart 

9.  Beamson  Tables 

10.  Program  Design  Language 


Structured  Programing 
Structured  Walkthroughs 


25.  Separate  compilation 

26.  Exceptions 

27.  Generic  program  wits 

28.  Instantiation 


29.  Elaboration 


APPENDIX  C 

ADA  SOFTWARE  DESIGN  METHODS  FORMULATION 

INDUSTRIAL  TRAINING  SURVEY 


Letter  to  Training  Survey  Respondent 
Survey 


March  5,  1982 


Dear  Training  Survey  Respondent: 

The  Center  for  Tactical  Computer  Systems,  U.S.  Army  Communication- 
Electronics  Cotsaand  (CECOM),  Fort  Monmouth,  NJ,  is  sponsoring  a  study  to 
identify  effective  approaches  for  the  use  of  Ada  in  designing  and 
developing  embedded  systems  software.  This  effort  is  part  of  the  Army 
Ada  Language  Program,  the  first  phase  of  a  major  software  technology  R&D 
initiative  intended  to  introduce  a  new  and  more  effective  method  for 
software  development  and  maintenance. 

Aa  part  of  this  study,  SofTech,  Inc.,  has  been  awarded  a  contract 
Co  conduct  a  survey  which  will  reflect  training  methods,  training 
programs  and  software  development  policies  of  company  divisions  involved 
with  embedded  computer  system  software.  The  person(s)  completing  this 
survey  should  have  management  level  training  responsibilities.  Your 
agreement  to  participate  in  this  survey  is  important  to  CECOM  in 
establishing  Ada  training  criteria  which  will  accurately  reflect  the 
needs  of  industry  and  government. 

Completed  surveys  should  be  returned  by  March  26,  1982  to 

SofTech,  Inc. 

460  Totten  Pond  Road 

Waltham,  MA  C2154 

If  there  are  any  questions  regarding  this  effort  please  contact  Xaren 
Sather  at  SofTech  (617-890-6900,  Ext.  137). 

Your  participation  is  a  hey  element  in  assuring  the  success  of  this 
survey  and  we  are  most  appreciative  of  your  efforts  on  our  behalf.  CECOM 
is  committed  to  transferring  the  Ada  technology  in  the  most  efficient  and 
timely  way  to  the  Ada  user  community.  The  published  results  of  this 
survey  will  be  sent  to  you  as  soon  as  they  are  available. 

Thank  you  for  your  time  and  effort. 

Very  truly  yours, 

Joseph  Reman 

Chief,  Software  Technology 
Development  Division 
CEMTACS 
CECOM 
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11-  Technical  Experience: 


24.  Which  of  these  formats  have  you  found  most  effective? 


Semi nars/sympos i a 
Videotapes 
Workshops 
Tutorial  texts 
Other 


Internally  developed  courses 
Contracted  training 
Project  leader/supervisor 
Printed  Materials 


IF  ANY  OF  YOUR  STAFF  HAVE  PARTICIPATED  IN  Ada  TRAINING,  ANSWER  THE  FOLLOWING  QUESTIONS: 


46.  Wliat  do  you  like  Most  about  Ada? 


APPENDIX  D 

ADA  SOFTWARE  DESIGN  METHODS  FORMULATION 


Report  of  the  Survey 
Statistical  Consultant 


Report  on  the  Ada  Software  Design  Methods  Formulation 


Industry/Government  Work  Force  Survey 


Robert  J.  Muller 
M.I.T. 

June  2,  1982 
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Executive  Summary 

The  Ada  Workforce  Survey  was  administered  as  a  nonrandom  sample  to  nine 
institutions.  Because  of  the  method  of  administration,  no  statistical  gener¬ 
alizations  may  be  made  to  a  general  population;  the  results  expressed  herein 
apply  only  to  the  sample. 

Various  single  variable  descriptions  indicate  that  the  sample  is  largely 
composed  of  individuals  who  have  been  in  the  workforce  for  more  than  ten 
years,  who  generally  haven't  been  trained  in  Ada,  who  have  worked  more  on  de¬ 
velopment  than  on  support,  who  are  more-or-less  professional  (as  defined  by 
belonging  to  technical  societies,  attending  conferences  and  so  on),  who  in 
general  spend  their  time  programming  or  designing  programs,  who  have  worked  on 
military  or  embedded  systems  (90  percent  of  the  workforce),  and  who  generally 
program  in  FORTRAN  or  Assembler  (or  both). 

There  are  few  significant  relationships  between  variables  in  the  survey. 
Involvement  with  Ada  to  a  small  extent  determines  knowledge  of  Ada. 

Classification  of  the  workforce  based  on  clustering  and  smoothing 
techniques  produces  five  fundamental  categories  of  worker:  administrative 
manager,  technical  manager,  support  manager,  development  nonmanager,  and  sup¬ 
port  nonmanager.  Comparison  of  the  various  variables  with  these  categories 
supports  the  interpretation  of  the  categories. 
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This  report  is  a  descriptive  analysis  of  the  Ada  Software  Design  Method 
Formulation  I ndustry/Government  Work  Force  Survey,  done  by  Softech  Inc.  under 
the  auspices  of  the  U.  S.  Army  Communications-Electronics  Command.  In  order 
to  place  this  report  in  its  proper  perspective,  the  survey  procedures  are 
briefly  outlined  below. 

The  sample. --Softech  administered  the  survey  as  a  mailed,  key-person  sur¬ 
vey.  That  is.  Softech  mailed  cooies  of  the  survey  to  certain  administrators 
in  each  organization  and  asked  that  person  to  distribute  the  survey  within  the 
organization  to  people  broadly  representative  of  the  company.  Softech 
exercised  no  control  over  the  internal  distribution  of  questionnaires,  relying 
totally  on  the  administrator.  There  was  no  reliable  attempt  at  random  distri¬ 
bution.  The-e  was  no  attt-pt  tc  weight  the  individual  questionnaires  received 
with  respect  to  any  sampled  population. 

The  implications  of  this  procedure  for  the  following  analysis  relate 
mainly  to  the  applicability  of  the  analysis  to  a  general  population.  A  sample 
is  a  subset  of  some  population,  that  population  being  defined  without  refer¬ 
ence  to  the  sampling  method.  In  the  case  of  a  random  sample,  the  members  of 
the  population  to  be  sampled  are  selected  by  first  knowing  some  characteristic 
by  which  al 1  of  the  population  might  be  indexed  (address,  phone,  name,  whatev¬ 
er)  .  The  sample  is  then  selected  by  some  criterion  designed  to  eliminate  all 
possible  influences  induced  by  considering  a  limited  number  of  the  population. 

Softech  has  apparently  defined  the  population  as  the  subset  of  the  orga¬ 
nization  that  some  administrator  in  the  organization  feels  can  complete  the 
survey  reasonably  and  have  some  "characteristic"  qualities  making  them  broadly 
rep-esentative  of  the  subset.  Thus  the  actual  population  being  sampled  is  de- 
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fined  differently  between  organi zat ions  and  possibly  within  organizations. 
There  is  no  possibility  of  modeling  the  sampling  process,  since  no  records 
were  kept  of  the  individual  assignment  decisions. 

The  result  of  these  procedures  is  to  have  an  unspecified  population.  The 
consequence  is  that,  although  this  report  states  certain  results,  there  is 
little  statistical  assurance  that  the  results  may  be  reliably  extended  to  any 
particular  population.  The  statistics  are  valid  for  the  sample  only. 

The  database. — The  sample  consists  of  i*28  surveys  of  9  organizations, 
five  in  the  private  sector  and  four  in  the  public  sector.  The  data  is 
organized  into  a  relational  database  consisting  of  nine  types  of  information 
(or  datasets) :  the  number  in  parentheses  after  the  dataset  name  is  the  number 
of  entities  in  that  dataset. 

(1)  job  history  (1*26) 

title 

rank 

date 

years  of  involvement  in  software 
level  of  involvement  with  Ada 
years  worked  on  development 
years  worked  on  support 
memoership  in  technical  societies 
conference  attendance 
published  or  presented  papers 
technical  reading 

(2)  job  output  (3.541) 

(3)  principal  duties  (2,542) 

(4)  general  activities  (9.841) 

activi ty 
importance 

(5)  conference  role  (106) 

(6)  programming  languages  (2,705) 

1 anguage 
prof i c i ency 

(7)  methodologies  (24,302) 

methodology 
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extent  of  knowledge 

(8)  areas  of  experience  (772) 

(9)  Ada  training  (189) 

This  structure  reflects  the  fact  that  all  of  the  attributes  except  for  the  job 
history  attributes  were  multiple  response  questions  and  hence  were  at  a  dif¬ 
ferent  level  from  the  survey  respondents--that  is,  a  given  respondent  may  have 
more  than  one  response  to  a  particular  Question.  Appendix  1  contains  a  com¬ 
plete  listing  of  the  datasets,  attributes,  and  possible  values  for  the 
attr i butes . 

The  structural  complexity  of  the  database  introduces  some  problems  with 
the  descriptive  statistics  in  the  following  sections.  Because  of  the 
multiple-response  structure  of  many  of  the  questions,  the  counts  of  reponses 
have  two  interpretations,  one  relative  tc  the  total  number  of 
reponses  ("response  level")  and  the  other  relative  to  the  total  number  of 
respondents  ("respondent  level").  Percentages  in  the  following  tables  labeled 
"Percent  of  Responses"  are  calculated  as  Count  divided  by  the  sum  of  Count 
over  all  responses.  Percentages  labeled  "Percent  of  Respondents"  are  Count 
divided  by  1*28  (the  number  of  respondents  in  the  survey).  The  first  percent¬ 
age  is  not  very  interpretable;  the  second  describes  the  status  of  a  response 
relative  to  the  respondents,  but  will  not  add  up  to  100,  since  a  given  indivi¬ 
dual  may  respond  with  more  than  one  response. 

Single-Variable  Descriptions 

Exoer i ence. — The  first  question  to  be  considered  is  how  many  years  the 
respondent  has  spent  in  software  development  and/or  support.  The  following 
table  gives  the  breakdown  of  the  four  possible  responses: 
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Counts 

Percent 

less 

than  two  years 

41 

9«7 

two 

to  five  years 

101 

23-9 

f  i  ve 

to  ten  years 

85 

20.1 

over 

ten  years 

196 

46-3 

This  table  indicates  that  almost  half  of  the  people  who  filled  out 
questionnaires  had  been  in  the  area  for  over  ten  years;  this  will  probably 
have  seme  effect  on  knowledge  and  job  patterns. 

Considered  together  are  the  two  questions  on  the  length  of  time  worked  on 
development  and  support.  The  following  two  tables  break  down  the  questions: 

Years  Worked  on  Development 


Counts 

Percent 

less  than  a  year 

78 

20.0 

one  to  three  years 

78 

20.0 

three  to  five  years 

65 

16.7 

over  five  years 

169 

43.3 

Years 

Worked 

on  Suppor 

Counts 

Percent 

less  than  a  year 

95 

33-1 

one  to  three  years 

73 

25-4 

three  to  five  years 

42 

14.6 

over  five  years 

77 

26.8 

The  import  of  these  frequencies  is  not  terribly  clear  without  taking  into  ac¬ 
count  the  relationships  between  these  two  variables.  There  are  four 
possibilities — the  respondent  worked  in  both  support  and  development,  the  re¬ 
spondent  worked  only  in  support,  the  respondent  worked  only  in  development,  or 
the  respondent  worked  in  neither  (or  didn't  answer  the  question).  Applying 
these  logical  combinations,  274  people  worked  in  both,  116  worked  in  develop¬ 
ment  but  not  support,  13  people  worked  in  support  but  not  development,  and  23 
people  apparently  worked  in  neither.  This  result  tends  to  swing  the  bias  to- 


1094-2 


0-7 


Ada  Workforce  Survey  Page 

ward  the  development  people. 

The  assumption  is  made  that  a  nonanswer  implies  not  working  in  that  area, 
an  assumption  that  might  not  be  justified.  It  is  possible  for  people  who  have 
done  no  work  in  the  area  to  respond  in  the  first  category,  0-1  year. 

Getting  back  to  the  original  issue,  the  separate  tables  indicate  that  the 
people  who  worked  on  development  tend  to  have  done  so  over  three  years  (the 
median  is  three  to  five) .  But  people  who  work  on  support  have  done  so  for 
more  than  one  year  (median  one  to  three  years).  Putting  this  together  with 
the  distribution  of  workers,  it  would  seem  that  the  industry  stresses  develop¬ 
ment  and  has  begun  employing  support  personnel  later  than  development  person¬ 
nel.  Another  interpretation  might  be  that  r-pport  personnel  have  a  higher 
turnover  rate  than  technical  personnel.  Without  company  employment  studies, 
neither  interpretation  can  be  falsified. 

Ada  involvement. --The  next  question  is  about  the  level  of  involvement  of 
the  person  with  Ada.  The  following  table  breaks  down  the  five  responses: 


Counts 

Percent 

Ada  not  known 

16 

3-8 

heard  of  Ada 

225 

52.9 

had  orientation  to  Ada 

101 

23-8 

Ada  training 

48 

11.3 

other 

35 

8.2 

This  table  indicates  that  only  a  third  or  so  of  the  workforce  has  any  re¬ 
al  knowledge  of  Ada  aside  from  having  heard  about  it.  Only  11  percent  of  the 
workforce  has  had  Ada  training.  An  implication  of  this  is  that  Ada  training 
will  have  to  affect  a  large  portion  of  the  industry;  another  implication  is 
that,  if  Ada  training  significantly  changes  the  way  people  do  their  jobs,  the 
industry  will  have  to  change  a  great  deal  as  use  of  Ada  becomes  widespread. 

Professional i sm.--Wi th  respect  to  technical  societies,  a  third  of  the 
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respondents  (142)  belong  to  technical  societies  and  two-thirds  of  them  (276) 
do  not.  With  respect  to  conference  attendance,  173  (41  percent)  have  attended 
a  conference  and  248  (59  percent)  have  not.  Of  those  who  had,  4  had  organized 
a  conference,  10  had  been  speakers,  91  had  been  attendees,  and  1  had  taken 
some  other  role.  With  respect  to  publishing  or  presenting  papers,  95  (23  per¬ 
cent)  have  done  so,  327  (78  percent)  have  not.  With  respect  to  technical 
reading,  the  following  table  breaks  down  the  possible  responses: 


Counts 

Percent 

regularly 

185 

44.0 

occasional 1y 

187 

44.5 

only  as  my  job  demands 

32 

7.6 

never 

14 

3-3 

other 

2 

0.5 

This  table  indicates  that  more  than  three  quarters  of  all  respondents  do  some 
reading  of  job-delated  magazines  or  newsletters.  What  this  means  is  unclear; 
such  newsletters  might  consist  of  company  rags  or  might  be  ACM  transactions. 
There  is  no  information  about  what  type  of  technical  reading  is  involved. 

These  last  questions  seem  to  be  aimed  at  identifying  certain  "profession¬ 
al"  aspects  of  the  respondent's  job.  Given  the  relative  vagueness  of  the  is¬ 
sues  addressed,  the  questions  don't  usefully  perform  this  task.  Professional¬ 
ism  has  deeper  roots  than  belonging  to  societies  or  going  to  conferences,  or 
even  presenting  papers.  It  matters  very  much  which  societies,  which 
conferences,  and  where  the  papers  are  presented  or  published,  among  other 
things. 

Job  outputs. — The  following  table  gives  the  breakdown  of  the  various  job 
output  products,  giving  the  percent  of  the  responses  made  and  the  percent  of 
people  giving  the  response  relative  to  the  total  sample  (428). 
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Output 

Count 

Percent  of 

Percent  of 

Responses 

Respondents 

hard  soft  tradeoff  eval 

125 

3-530 

29. 206 

data  flow  diagrams 

197 

5-563 

46.028 

test  drivers 

150 

4.236 

35-047 

code 

287 

8.105 

67.056 

prog  design  language 

262 

7-399 

61.215 

requirements  specs 

223 

6-298 

52.103 

design  specs 

255 

7.201 

59.579 

test  plans 

236 

6-665 

55-140 

integration  plans 

165 

4.660 

38-551 

management  plans 

99 

2.796 

23.131 

cost  data 

104 

2.937 

24.299 

analysis  reports 

111 

3.135 

25-935 

milestone  charts 

173 

4.886 

40.421 

status  reports 

223 

6.298 

52.103 

interview  sheets 

116 

3.276 

27.103 

correspondence 

92 

2.598 

21.495 

development  other 

14 

0.395 

3-271 

STR  analyses 

97 

2.739 

22.664 

temp  ECPs 

46 

1.299 

10.748 

redlined  documentation 

52 

1.469 

12.150 

support  test  plans 

70 

1.977 

16.355 

support  test  drivers 

40 

1.130 

9-346 

tech  advice  to  CC8 

40 

1.130 

9-346 

updated  ML  STD  spec 

20 

0.565 

4.673 

1 ibrary  control 

25 

0.706 

5.841 

maintain  config  procs 

32 

0.904 

7.477 

updated  training  manuals 

24 

0.678 

5. 607 

updated  user  manuals 

71 

2.005 

16-589 

STRs 

85 

2.400 

19-860 

automated  build  systems 

20 

0.565 

4.673 

management  info  reports 

32 

0.904 

7.477 

version  descrip  docs 

20 

0.565 

4.673 

version  audits 

11 

0.311 

2.570 

field  engineering  report 

8 

0.226 

1.369 

support  other 

16 

0.452 

3-738 

The  following  list  of  the  values 

presents  the 

values  in  rank  order 

Percent  of 

Output 

Respondents 

code 

67-056 

prog_des i gn_l anguage 

61.215 

design_specs 

59-579 

test_plans 

55- 1W 

status_reports 

52.103 

requi rements_specs 

52.103 

da ta_f 1 ow_d i agrams 

46.028 

mi  lestone_charts 

40.421 

intcgration_p!ans 

33-551 
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test_dr i vers 

35.01*7 

hard_sof  t_tradeof f _eva 1 

29-206 

i ntervi ew_sheets 

27.103 

analysi s_reports 

25-935 

cost_data 

24.299 

management_pl ans 

23-131 

STR_ana 1 yses 

22.864 

correspondence 

21.495 

STRs 

19-860 

updated_user  jnanua 1 s 

16-589 

support_test_plans 

16.355 

red  1 i ned_documentat i on 

12.150 

temp_£CPs 

10.748 

support_test_dr i vers 

9-346 

tech_adv i ce_to_CCB 

9-346 

management^  nfo_repor ts 

7-477 

ma i nta i n_conf i g_procs 

7-477 

1 i brary_control 

5-841 

updated_tr a i n i ng_manua 1 s 

5- 607 

automated_bui ld_sys terns 

4.673 

updated_MI L_STD_spec 

4.673 

vers i on_descr i p_docs 

4.673 

support_other 

3-738 

deve lopment_other 

3.271 

vers i on_audi ts 

2.570 

f  i  eld_engi  peer  i  ng_report 

1.369 

This  table  describes  the  number  of  people  who  do  a  certain  thing,  without 
taking  into  consideration  what  else  they  do.  Thus,  67  percent  of  the 
respondents  produce  code,  81  percent  produce  program  design  language,  80  per¬ 
cent  produce  design  specifications,  and  so  on.  There  does  seem  to  be  a  gener¬ 
al  tendency  toward  those  categories  directly  related  to  programming  in  a  tech¬ 
nical  sense;  as  well,  people  tend  to  produce  development  outputs  more  often 
than  support  outputs.  This  paints  the  picture  of  an  industry  more  oriented 
toward  producing  software  than  toward  supporting  software. 

The  section  on  classification  below  will  discuss  the  relationships  be¬ 
tween  respondents  based  on  combinations  of  responses — patterns  of  job 
responsibilities  and  behaviors.  These  patterns  will  bs  the  basis  for  the  job 
classification  scheme. 

As  a  comment,  this  question  (and  the  next  question  on  principal  duties) 
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might  have  been  structured  as  the  later  questions  were,  including  some 
weighting  variable  such  as  how  much  time  is  spent  on  a  product  or  on  a  duty. 
This  might  give  a  clearer  picture  of  job  structure.  On  the  other  hand,  explo 
ration  of  the  variation  indicates  that  most  of  the  reasonable  conclusions  are 
robust — not  subject  to  relative  extremes  in  the  data.  Having  information 
weighting  the  responses  would  probably  not  affect  the  results  very  much. 

Principal  duties. — The  following  table  tabulates  the  responses  to  the 
question  about  what  the  respondent's  principal  duties  were: 


Duty 

Count 

Percent  of 
Responses 

Percent  of 
Respondents 

conduct  req  review 

9k 

3-698 

21.963 

attend  req  review  . 

ii*7 

5-783 

3A.  31*6 

system  analysis 

193 

7-592 

*5.093 

des i gn 

271 

20.661 

63.318 

conduct  design  review 

151 

5.91*0 

35-280 

attend  design  review 

196 

7-720 

1*5.791* 

code 

233 

$.2kS 

5k. 907 

conduct  walkthroughs 

108 

1*.2I*9 

25.23k 

attend  walkthroughs 

128 

5.035 

29.907 

formulation  of  policy 

1*6 

1.810 

10.7k8 

formulation  of  strategy 

60 

2.360 

Ik. 019 

technical  management 

118 

1*  .61*2 

27.570 

program  management 

31 

1.220 

7.243 

configuration  management 

33 

2.220 

7.243 

quality  assurance 

31 

1.220 

7-243 

monitoring  contracts 

23 

0.905 

5.37k 

other  development 

10 

0.393 

2.336 

support  analysis 

101 

3.973 

23-598 

support  design 

86 

3.383 

20.093 

conduct  support  dr 

k6 

1.810 

10.7k8 

attend  support  dr 

71* 

2.911 

17.290 

code  patch 

88 

3.k62 

20.561 

conduct  sup  walkthrough 

35 

1.377 

8.178 

attend  sup  walkthrough 

52 

2 .01*6 

12.150 

sup  technical  management 

1*1* 

1.731 

10.280 

sup  policy  formulation 

17 

0.669 

3.972 

sup  program  management 

13 

0.521 

3-037 

SCCB  participation 

36 

2.1*26 

8.1*11 

sup  config  management 

20 

0.787 

4.673 

suo  quality  assurance 

25 

0.983 

5.841 

sup  monitoring  contracts 

19 

0.71*7 

4  -  439 

other  support 

13 

0.511 

3.037 
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The  following  list  presents  the  above  values  in  rank  order. 

Percent  of 


Duty  Respondents 

des i gn 

63-318 

code 

54.907 

attend_des i gn_review 

45-794 

system_ana lysis 

45.093 

conduct_des i gn_revi ew 

35.280 

a  t  tend_r  eq_r  ev i ew 

34.346 

attend_wa 1 kthroughs 

29.907 

techni ca l_management 

27.570 

conduct_wa 1 kthroughs 

25.234 

support_analysi  s 

23.598 

conduc  t_r  eq_r  ev i ew 

21.963 

code_patch 

20.561 

support_desi gn 

20.093 

attend_support_dr 

17.290 

f ormul at ion_of_strategy 

14.019 

attend_sup_wa 1 kthrough 

12.150 

formu!ation_of_pol icy 

10.748 

conduc  t_suppor  t_dr 

10.748 

$up_technical_management 

10.280 

SCCB_par t i C i pat i on 

8.411 

ccnduct_sup_wal kthrough 

8-178 

program_management 

7.243 

conf i gurat i on_management 

7.243 

qual i ty_assurance 

7.243 

sup_qual i ty_assurance 

5.841 

moni tor i ng_contracts 

5.374 

sup_conf i g_management 

4.673 

sup_moni tor i ng_contracts 

4.439 

sup_pol icy_formulation 

3.972 

sup_program_management 

3.037 

other_support 

3.037 

other_development 

2.336 

This  table  demonstrates  the  same  general  tendencies  as  the  table  of  job 
outputs — the  largest  percentages  are  the  technical  programming  duties,  and 
there  is  a  general  tendency  toward  development  and  away  from  support.  As 
well,  both  tables  show  a  relatively  low  set  of  percentages  for  various  admin¬ 
istrative  tasks  such  as  correspondence  or  formulation  of  policy.  This  may  in¬ 
dicate  that  these  things  aren't  important;  more  likely,  it  indicates  that  the 
people  who  do  them  are  a  small  administrative  cadre,  probably  higher  up  in  the 
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organization  than  the  bulk  of  the  respondents.  There  is  no  way  to  verify  this 
conclusion  from  the  data.  Some  support  for  this  interpretation  comes  from  the 
clustering  scheme  presented  in  the  classification  section  below. 

Areas  of  exper i ence . --The  question  on  areas  of  experience  breaks  down 
according  to  the  following  table: 


Area 

Count 

Percent  of 
Responses 

Percent  of 
Respondents 

commerc i a  1 

148 

19.171 

34.579 

mi  1 i tary 

343 

44.430 

80.140 

embedded  computer 

sys  173 

22.409 

40.421 

educational 

51 

5.606 

11. 916 

statistical 

25 

3.238 

5.841 

other 

32 

4.145 

7.477 

Not  surprisingly  for  firms  doing  defense  work,  most  people  have  done  work  in 
the  military  arena.  Given  that  Ada  applies  to  embedded  computer  systems,  the 
relatively  low  percentage  of  pecple  (173,  or  40  percent  of  the  total)  that 
have  worked  on  embedded  systems  might  mean  that  any  classification  scheme 
developed  from  this  sample  will  not  necessarily  be  appropriate  for 
organizations  doing  embedded  system  work. 

However,  there  is  some  question  of  spurious  semantic  distinction.  It 
would  appear  that  the  term  "embedded  computer  system"  is  relatively  new  and 
not  well  known  in  the  industry  as  yet.  133  respondents  (31  percent)  responded 
with  both  military  and  embedded.  40  (f.3  percent)  responded  embedded  alone; 
210  (43*5  percent)  responded  military  alone.  There  is  some  indication  that 
those  responding  embedded  also  specify  military  more  often  than  those  who 
responding  military  also  specify  embedded  (77  versus  39  percent,  respective¬ 
ly)  .  This  might  indicate  hierarchical  knowledge  or  hierarchical  work.  Hier¬ 
archical  knowledge  means  that  knowledge  of  what  an  embedded  system  is  implies 
knowing  that  it  is  mainly  military,  hence  explaining  the  large  overlap  in 
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responses;  and  not  knowing  implies  thinking  that  the  job  one  does  is  military, 
not  embedded,  even  though  it  might  be  so  considered  by  somebody  who  knew  what 
an  embedded  system  is,  thus  explaining  the  large  number  of  military-only 
responses.  Hierarchical  work,  on  the  other  hand,  means  that  people  who  work 
on  embedded  systems  generally  are  in  the  military  field  as  well,  but  those  in 
the  military  field  are  not  necessarily  or  frequently  employed  in  embedded  sys¬ 
tem  work.  The  survey  data  has  no  information  sufficient  to  distinguish  these 
explanations. 

Ada  trai ni nq . --Look i nq  at  the  last  question  to  be  considered  in  this  sec¬ 
tion,  those  people  who  have  had  some  training  in  Ada  have  trained  in  the  fol¬ 
lowing  ways: 

Percent  of 
Respondents 
Percent  of 

Responses  Percent  of 


Training  Method 

Count 

Those  Trained 

videotape 

16 

8.466 

3-738 

12.030 

col lege_course 

7 

3.704 

1.636 

5.263 

i n_house_course 

1*6 

24-339 

10.748 

34.586 

pr  og  r  ammed_ learning 

5 

2.646 

1.168 

3.759 

seminar 

43 

22.751 

10.047 

32.331 

i nf ormal_trai ni ng 

51 

26-984 

1 1 .9 16 

38.346 

other 

21 

11.111 

4.907 

15.789 

Three  quarters  of  the  methods  people  used  are  in-house  courses,  seminars,  or 
informal  training.  This  breakdown  might  be  explained  by  the  other  methods  not 
being  widely  available  yet.  As  well,  40  percent  of  the  respondents  have  had 
training  of  any  sort;  compare  this  with  the  frequencies  reported  above  for 
level  of  involvement  with  Ada:  48  people  (11  percent)  report  training  there. 
The  following  table  breaks  down  the  type  of  training  by  Ada  involvement  in  an 
attempt  to  resolve  this  inconsistency: 
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had  orientation  to  Ada 
heard  of  Ada  other 

Ada  not  known  Ada  training 


Ada  training 
videotape 
col 1 ege  course 
in  house  course 
programmed  learning 
semi nar 

informal  training 
other 


0  0  3  9  4 

0  0  0  6  1 

0  1  15  26  4 

0  0  2  3  0 

0  0  28  12  3 

0  3  19  15  14 

0  3  7  6  5 


Apparently,  what  happened  is  that  people  who  participated  in  orientation 
sessions  on  Ada  proceeded  to  answer  the  Ada  training  question  as  well;  the 
responses  indicate  seminars  and  informal  training  are  the  most  important  in 
this  group.  As  well,  11*  people  with  "other"  involvement  said  they  had  infor¬ 
mal  training.  In  the  next  section,  the  relationship  between  years  in  the  in¬ 
dustry  and  Ada  training  will  be  considered.  The  level  of  involvement  question 
is  net  very  specific;  the  training  qua s tier*  is  probably  a  mere  specific  ver¬ 
sion  of  the  same  thing. 


Two-Variable  Comparisons 

The  first  part  of  this  section  is  devoted  to  presentation  of  the  parts  of  the 
survey  data  that  associate  some  measure  of  knowledge  or  importance  with  vari¬ 
ous  categories.  The  first  is  general  activites,  rated  by  importance;  the  sec¬ 
ond  is  methodologies  and  concepts  rated  by  knowledge;  the  third  is  programming 
languages,  rated  by  proficiency.  The  second  part  of  this  section  is  concerned 
with  relating  some  of  the  various  questions  to  each  other.  The  following  con¬ 
tingency  tables  have  chi  square  statistics  significant  at  the  99  percent  level 
unless  stated  otherwise. 

General  activities. — The  following  table  contains  counts  and  percents  for 
the  three  importance  categories  (primary,  secondary,  marginal).  Percents  are 
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relative  to  the  respondents  (count  divided  by  2*28).  The  last  column  is  the 

total  number  of  responses  for  the  activity. 

General  Activities  by  Importance 

Secondary  Count  Marginal  Percent 
Primary  Percent  Marginal  Count 
Activity  Primary  Count  Secondary  Percent  Total  Count 


program  management 

30 

7.009 

38 

8.879 

41 

9-579 

109 

sales  marketing 

8 

1.869 

24 

5. 607 

40 

9-346 

72 

contract  negotiation 

5 

1.168 

19 

4.439 

46 

10.748 

70 

formulating  policy 

27 

6.308 

32 

7.477 

48 

11.215 

107 

formulating  strategy 

A3 

10.047 

45 

10.514 

56 

13-084 

5  44 

preparing  budgets 

59 

13-785 

74 

17.290 

61 

14.252 

194 

technical  management 

121 

28.271 

47 

10.981 

37 

8.645 

205 

interviewing  personnel 

34 

7.944 

49 

11.449 

90 

21.028 

173 

preparing  schedules 

68 

15.888 

98 

22.897 

75 

17.523 

241 

preparing  mgmt  info  rpts 

47 

10.98’. 

78 

18  -  22i+ 

55 

12.850 

180 

preparing  fid  eng  rpts 

1 

0.234 

15 

^•505 

26 

6.075 

42 

other  admin  tasks 

20 

4.673 

53 

12.383 

67 

15-654 

140 

tech  advice  to  CCB 

33 

7.710 

50 

11.682 

58 

13.551 

141 

maint  config  procs 

20 

4-673 

44 

10.280 

67 

15-654 

131 

1 i brary  control 

12 

2.804 

32 

7.477 

57 

13. 318 

101 

preD  version  audits 

12 

2.801 

15 

3.505 

33 

7.710 

60 

qual i ty  assurance 

25 

5-841 

36 

8-411 

62 

14.486 

123 

prep  temp  eng  change  rpt 

20 

4.673 

54 

12.617 

56 

13-084 

130 

prep  technical  rpts 

45 

10.514 

93 

21.729 

96 

22.430 

234 

reading  tech  pubs 

55 

12.850 

146 

34.112 

124 

28-972 

325 

reviewing  tech  work 

102 

23-832 

143 

33.411 

66 

15.421 

311 

teaching 

44 

10.280 

105 

24.533 

124 

28-972 

273 

updating  training  manual 

11 

2.570 

34 

7-944 

80 

18-692 

125 

being  trained 

42 

9-813 

83 

19.393 

136 

31.776 

261 

func  system  design 

193 

45.093 

67 

15.654 

62 

14.486 

322 

func  module  design 

215 

50.234 

72 

16.822 

44 

10.280 

331 

def  global  data  strucs 

137 

32.009 

100 

23-364 

59 

13-785 

296 

def  subsystem  interface 

157 

36.682 

103 

24.065 

58 

13.551 

318 

def  stuff  for  own  use 

174 

40.654 

78 

18-224 

54 

12.617 

306 

coding 

195 

45-561 

65 

15.187 

58 

13.551 

318 

debugging  or  modifying 

204 

47.664 

61 

14.252 

56 

13.084 

321 

prep  sys  rqt  docs 

96 

22.430 

86 

20.093 

69 

16.121 

251 

updating  MIL  STD  specs 

26 

6.075 

47 

10.981 

46 

10.748 

119 

prep  red  I i ned  docs 

41 

9.579 

56 

13.084 

63 

14.720 

160 

prep  version  descr  mnis 

29 

6.776 

50 

11.682 

85 

19. 860 

164 

prep  user  manuals 

44 

10.280 

108 

25.234 

91 

21.262 

243 

documenting  code 

141 

32.944 

108 

25.234 

42 

9. 813 

291 

defining  test  cases 

87 

20.327 

101 

23-598 

65 

15-187 

253 

prep  test  drivers 

58 

13-551 

94 

21.963 

73 

17-056 

225 

prep  test  pians 

99 

23.131 

99 

23.131 

72 

16.822 

270 

hardware  testing 

23 

5-374 

41 

9-579 

79 

18-458 

143 

system  software  test 

162 

37-850 

98 

22.897 

53 

12.383 

313 

defining  mod  test  cases 

115 

26-869 

85 

19. 860 

74 

17.290 

274 
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software  modu'e  testing 
documenting  test  results 
prep  trouble  -e oorts 
anaiyiing  trouble  rpts 

The  above  va’ves,  rankea 


Act i v i ty 

of 

f unc_modu ! e_des i gn 
defcugg i ng_or_mcd i f y i ng 
cod i ng 

f urc_system_des i gn 
def_stuf  f_f or_own_use 
sy  s  teiT>_sof  twar  e_t  es  t 
def_subsystem_; nterface 
sof tware_nodule_testi ng 
documen  t i ng_code 
def_g 1 oba !_data_s trues 
techn i C2 ’_management 
def i n i ng_mod_tes  t_eases 
rev i ewi ng_tech_wcrk 
preo_test_p!ans 
pr ep^sy  s__r p  t_ccc c 
def i n i ng_test_cases 
ana 1  yz  i ng_t roub i e_rp ts 
document i ng_test_resu ! ts 
prepar i ng_schedul  es 
prep_troub 1 s_repor  ts 
prepar i ng_budgets 
prep_test_dr i vers 
read  i  ng_tech_pubs 
prepar i ng_mgnt_i nf o_rpts 
prep_techni cai_rpts 
teach  i  r,g 

prep_user_m3nua  i  s 
formula* i ng_strategy 
be  i  ng_tre  i  r.ed 
pi-ep_r«d !  I  ned_docs 
i ncervi ewi ng_pe-sorne! 
tecr_acv ! ce_tc_CC3 
program^  T3nagement 
prep_vers 1 cn_descr_nn 1 s 
for  mu 1  at  i  ng_po I  icy 
updati ng_M L_STD_;pecs 
Qua  1 ty_assurance 
hardi.are_test '  ng 
pr •D_tC"o_eng_change_rpt 
ot!"f_acm;  n_tas<s 
na '  't_cc"*  ’  g_pi*ocs 
premiers i or_aud i ts 


152 

35  • 

.514 

81 

18. 

925 

55 

12. 

,850 

288 

75 

17< 

■  523 

112 

26. 

.  168 

78 

18. 

.224 

265 

66 

1  c 

•  -/  1 

.421 

85 

19. 

■  860 

8b 

20, 

.093 

237 

95 

19 

■  860 

89 

20. 

■  794 

67 

15, 

.654 

241 

by  the  count  of  primary  importance,  are: 


Pr inary 
Percent 
Respondents 


50.231, 
i  ?  -661* 
45-561 
1*5.033 
1*0. 65** 
37-850 
36.682 
35.5:4 
32.944 
32. COS 
28-271 
26.869 
23-832 
23.131 

20.127 
19. 360 
17.523 
15-888 
15-421 
13-735 
13-551 
12.850 
10.381 
10.5U 
10.280 
10.280 
10.047 
9- 813 
9.579 
7-944 
7-710 
7-003 
6-776 
5.3CS 
6.075 
5.841 
5-374 
4.673 
4.673 
4.673 
2.3Cu 
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I  i  brary_control  2 . 801* 
updating_training_manual  2.570 
sa I es_market i ng  1*869 
contract_negotiation  1*168 
prepar i ng_f ld_eng_rpts  0.23k 


This  ranking  indicates  the  importance  of  the  activities  to  the  industry 
as  a  whole,  not  to  the  respondents.  The  scheme  presented  below  in  the  classi 
fication  section  shows  that  various  subgroups  who  engage  in  very  different 
activities  exist;  a  particular  activity  may  be  much  more  important  to  one 
group  than  to  another.  As  well,  the  ranking  does  not  address  the  conceptual 
importance  of  the  activities;  contract  negotiation  isn't  done  by  very  many 
people,  but  it  is  clearly  a  vital  industry  activity. 

Methodologies. — The  following  table  presents  the  methodologies 
crosstabulated  with  the  knowledge  of  the  methodology.  The  percents  are  calcu 
lated  as  percent  o f  the  respondents  (count  divided  by  1+28)  • 


Knowledge  of  Methodologies 

Used  Moderately 

Percent  Percent  Used  Frequently 

Methodology  Heard  of  Know  Concept  Percent  Percent 


PSL  PLA 

k8 

11.215 

88 

20.561 

15 

3*505 

0 

0.000 

SADT 

23 

5*  37k 

36 

8  •  k  1 1 

18 

k.206 

2 

0.k67 

SREM 

22 

5-1  k0 

3k 

7*9kk 

k 

0.935 

1 

0.23k 

HIP0 

k9 

1 1  *kk9 

128 

29-907 

91 

21.262 

30 

7*009 

Jackson  Design 

3k 

7  *9kk 

36 

8  *  k  1 1 

13 

3*037 

10 

2.336 

Structured  Design 

lk 

3*271 

75 

17*523 

118 

27*570 

185 

k3*22k 

Warnier  Orr  Oesign 

39 

9*112 

51 

11*916 

18 

k .  206 

5 

1*168 

N  S  Chapin  Chart 

38 

8*879 

k0 

9.3k6 

17 

3*972 

6 

l.k02 

Beamson  Tables 

9 

2.103 

6 

l.k02 

1 

0.23k 

0 

0.000 

Program  Design  language 

35 

8*178 

10k 

2k. 299 

98 

22.897 

12  k 

28*972 

Structured  Programming 

7 

1*636 

53 

12.383 

103 

2k. 065 

261 

60.981 

Structured  Walkthroughs 

20 

k  *673 

121 

28.271 

12k 

28*972 

115 

26*869 

Top  Down  Design 

6 

1 .  k02 

5k 

12.617 

121 

28.271 

238 

55*607 

Top  rnwn  Testing 

15 

3*505 

112 

26.168 

118 

27*570 

153 

35*748 

Bottc.ii  Up  Design 

18 

k*206 

170 

39*720 

109 

25-467 

69 

16.121 

8achman  Diagramming 

15 

3*505 

23 

5-374 

2 

0.k67 

3 

0.701 

Entity  Diagrams 

12 

2.80k 

22 

5*lk0 

7 

1*636 

3 

0.701 

Data  Abstraction 

k0 

9*3k6 

77 

17*991 

k5 

10.51k 

27 

6.308 

other  methodology 

0 

0.000 

2 

0.k67 

5 

1.168 

8 

1.869 

1094-2 


D-19 


Ada  Workforce  Survey 


Page  18. 


enumeration  types 

28 

6-542 

floating  ooint  types 

7 

1-636 

f i xed  point  types 

5 

1-168 

user  defined  types 

20 

4.673 

po i nters 

6 

1.402 

typed  po i nters 

33 

8-879 

ranges 

15 

3-505 

records 

10 

2-336 

variant  records 

35 

8.178 

object  type  dels 

18 

4.206 

global  variables 

5 

1.402 

local  variables 

5 

1  •  168 

forma!  actual  params 

19 

4.439 

reserved  words 

9 

2.103 

blocks 

7 

1-636 

case  statements 

11 

2.570 

if  then  else  statements 

2 

0.467 

loop  for  while  unti 1 

2 

0.467 

ex i t  statements 

3 

O.701 

procedures 

9 

2.103 

f unct : ons 

5 

1.168 

return  statements 

3 

0.701 

clusters  modules  package 

28 

6-542 

stubs 

17 

3-972 

goto  statements 

1 

0.234 

£C!T,rn£r}  1 5 

1 

0.234 

exception  handlers 

24 

5- 607 

task  coroutines 

26 

6. 075 

other  prog  constructs 

0 

0.000 

importing  exporting  name 

39 

9-112 

data  encapsulation 

48 

11.215 

name  scoping 

33 

7.710 

name  visibility 

40 

9-346 

static  dynamic  nesting 

57 

13.3'-8 

i terat i on 

13 

3.037 

conditional  statements 

7 

1.636 

recurs  ion 

14 

3.271 

concur rency 

29 

6.776 

strong  typing 

31 

7.243 

type  conversion 

29 

6.776 

data  abstraction 

56 

13.084 

gener i cs 

45 

IO.514 

loop  invar? ants 

51 

11.916 

parameter  binding 

53 

12.383 

version  number 

20 

4.673 

other  prog  concepts 

1 

0.234 

Ada  enumeration  types 

44 

10.280 

Ada  user  defined  types 

40 

9-346 

Ada  suotypes 

56 

13-084 

Ada  derived  types 

63 

14.720 

Ada  real  types 

31 

7.243 

Ada  float  point  types 

26 

6.075 

Ada  fixed  pt  types 

24 

5. 607 

72 

16-822 

68 

15.888 

59 

13.785 

73 

17-056 

128 

29-907 

205 

47.897 

46 

10.748 

106 

24-766 

246 

57.A77 

85 

20.561 

111 

25.935 

139 

32.477 

64 

14-953 

106 

24-766 

220 

51.402 

96 

22.430 

65 

15-187 

304 

24.299 

97 

22.664 

104 

24.299 

143 

33.411 

72 

16-822 

108 

25.234 

206 

48.131 

89 

20.794 

68 

15.888 

93 

21.729 

75 

17.523 

105 

24-533 

148 

34.579 

34 

7-944 

9A 

21-963 

2S2 

65.888 

31 

7-243 

88 

20.561 

289 

67.523 

42 

9- 813 

79 

18-458 

217 

50.701 

58 

13-551 

85 

19- 860 

243 

56.776 

65 

15-187 

98 

22.897 

209 

48.832 

52 

12.150 

101 

23-598 

227 

53-037 

33 

7.710 

93 

21.729 

290 

67.757 

42 

9- 813 

93 

22.897 

274 

64.019 

76 

17.757 

123 

28-738 

206 

48.131 

35 

8.178 

95 

22.196 

273 

63.785 

32 

7-477 

108 

25.234 

270 

63.084 

32 

7-477 

30 

18-692 

303 

70.794 

75 

17.523 

105 

24.533 

155 

36.215 

81 

18- 925 

103 

24.065 

145 

33.879 

67 

1  *• 

15-654 

t  ?  ** 

135 

31.542 

*  n  **  *•  ■ 

211 

49-299 

• 

A  •'O/ 

t  Z 

13.2:4 

-r  ✓ 

75-467 

98 

22.897 

95 

22.196 

133 

31.075 

113 

26-402 

78 

18-224 

115 

26.869 

2 

0.467 

2 

0.467 

3 

0.701 

45 

10.514 

21 

4-907 

33 

7.710 

93 

21.729 

61 

14.252 

60 

14.019 

65 

15-187 

34 

7-944 

60 

14.019 

62 

14.486 

32 

7.477 

47 

10.981 

86 

20.093 

60 

14.019 

75 

17.523 

48 

11.215 

109 

25-467 

222 

51.869 

22 

5-140 

88 

20.561 

286 

66.822 

102 

23*832 

138 

32.243 

122 

28.505 

120 

28-037 

80 

18.692 

82 

19.159 

90 

21.028 

57 

13. 318 

65 

15.187 

81 

18- 925 

96 

22.430 

110 

25.701 

110 

25.701 

45 

10.514 

59 

13.785 

97 

22.664 

40 

9.346 

32 

7.477 

76 

17.757 

48 

11.215 

50 

11.682 

84 

19-626 

38 

8.879 

45 

10. 5H 

73 

17-056 

77 

17.991 

136 

31.776 

0 

0.000 

1 

0.234 

5 

1.168 

103 

24.065 

28 

6.542 

16 

3-738 

149 

34-813 

30 

7.009 

30 

7.009 

105 

24.533 

18 

4.206 

19 

4.439 

83 

19.393 

17 

3.972 

9 

2.103 

149 

34.813 

32 

7.477 

51 

11.916 

162 

37-850 

36 

3.411 

59 

13.785 

156 

36-449 

34 

7.944 

61 

14.252 
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Ada  record  types 

Ada  rec  types  discrim 

Ada  s 1 i ces 

Ada  aggregates 

Ada  al locators 

Ada  access  types 

Ada  overloading 

Ada  packages 

Ada  private  types 

Ada  scope 

Ada  short  circuiting 

Ada  visibility 

Ada  tasking 

Ada  task  types 

Ada  rendezvous 

Ada  entries 

Ada  entry  f ami  1 i es 

Ada  separate  compilation 

Ada  exceptions 

Ada  generic  prog  units 

Ada  instantiation 

Ada  elaboration 

Ada  context  spec 

Ada  information  hiding 

Ada  mutual  recursion 

other  Ada  concepts 


35  8.178  138  32.243 

57  13. 318  75  17.523 

42  9. 813  51  U. 916 

45  10.5U  59  13-785 

38  8-879  61*  11* -953 

39  9.112  85  19. 860 

1*0  9.31*6  83  19.393 

43  10.047  109  25-467 

35  8.178  105  24.533 

32  7-477  113  26-402 

35  8.178  49  11-449 

40  9-346  93  21.729 

55  12.850  133  31.075 

58  13.551  101  23-598 

30  7.009  92  21.495 

34  7-944  106  24.766 

47  10.981  47  10.981 

26  6-075  147  34-346 

33  7.710  116  27.103 

46  10.748  81  18. 925 

39  9-112  66  15.421 

37  8.645  47  10.981 

47  10.981  59  13-785 

38  8-879  108  25.234 

50  11.682  59  13.785 

1  0.234  0  0.000 


31 

7.243 

45 

10.514 

14 

3.271 

9 

2.103 

10 

2-336 

8 

1.869 

9 

2.103 

8 

1-869 

11 

2.570 

6 

1.402 

14 

3.271 

14 

3.271 

9 

2.103 

F 

1.869 

18 

4-206 

1  _ 

2.804 

13 

3.037 

6 

1.402 

12 

2.804 

22 

5.140 

7 

1.636 

5 

1.168 

13 

3.037 

13 

3.037 

14 

3.271 

27 

6. 308 

10 

2.336 

10 

2-336 

10 

2.336 

7 

1.636 

13 

3.037 

19 

4.439 

7 

1.636 

6 

1.402 

24 

5.607 

41 

9-579 

22 

5-140 

21 

4-907 

12 

2.804 

5 

1.168 

7 

1.636 

6 

1.402 

6 

1.402 

6 

1.402 

6 

1.402 

4 

0.935 

9 

2.103 

14 

3.271 

7 

1.636 

5 

1.168 

0 

0.000 

0 

0.000 

The  above  table  has  no  valid  chi  square  statistic  due  to  low  cell  expectancies 
for  some  cells  (that  is,  an  unequal  distribution  of  responses  makes  the  chi 
square  statistic  unreliable).  The  list  below  contains  the  methodologies 
ranked  by  the  summed  percentages  of  those  methodologies  used  frequently  or 
moderately.  Each  group  of  methodologies  (methodologies,  programming  con- 
s.ructs,  programming  concepts,  and  Ada  concepts)  is  separately  ranked. 


Percent  of 

Methodology  Respondents 

methodologies 

Structured  Programming  85-047 

Top  Down  Design  83-879 

Structured  Design  70.794 

Top  Down  Testing  63*318 

Structured  Walkthroughs  55-841 

Program  Design  language  51.869 

Bottom  Up  Design  41.589 

Hip0  28.271 
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Data  Abstraction 

16.822 

Jackson  Oesign 

5.37k 

Warnier  Orr  Oesign 

5-37k 

N  S  Chapin  Chart 

5.37k 

SAOT 

k.673 

PSl  PLA 

3.505 

other  methodology 

3.037 

Enti ty  0 i agrams 

2.336 

Bachman  Diagramming 

1.168 

SR£M 

1.168 

Beamson  Tables 

0.23k 

programming  constructs 

comments 

93.692 

return  statements 

89 . k86 

if  then  else  statements 

89-k86 

funct i ons 

88-318 

local  variables 

88.08k 

global  variables 

87.850 

loop  for  while  unti  1 

86.916 

procedures 

85-981 

fixed  point  types 

82.2k3 

goto  statements 

80.8kl 

floating  point  types 

77.80k 

exi t  statements 

76.569 

case  statements 

76.636 

reserved  words 

76.636 

poi nters 

76.168 

records 

73.36k 

blocks 

71.729 

formal  actual  params 

69-159 

clusters  modules  package 

60.7U8 

object  type  dels 

59.112 

user  defined  types 

58 . k  1 1 

stubs 

57-9kk 

ranges 

57-710 

exception  handlers 

53.271 

task  coroutines 

k5.093 

typed  pointers 

39.486 

variant  records 

37.617 

enumeration  types 

29.673 

programming  concepts 

conditional  statements 

87.383 

i teration 

77-336 

recursion 

60.71*8 

version  number 

1*9-766 

type  conversion 

ka.131 

concurrency 

37.850 

static  dynamic  nesting 

3l.5k2 

strong  typing 

28-505 
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data  encapsulation  28 -271 
data  abstraction  24.299 
loop  invariants  22.897 
name  scoping  21.963 
parameter  binding  19- 393 
name  visibility  18-1*58 
generics  16-822 
importing  exporting  name  12.617 
other  prog  concepts  1 .  i»02 
other  prog  constructs  1.168 

Ada  concepts 

Ada  float  point  types  22.196 
Ada  fixed  pt  types  22.196 
Ada  real  types  19-393 
Ada  record  types  17-757 
Ada  separate  compilation  15-187 
Ada  user  defined  types  li*. 019 
Ada  enumeration  types  10.280 
Ada  exceptions  10.01*7 
Ada  tasking  9-579 
Ada  subtypes  8-645 
Ada  scope  7-944 
Ada  entries  7-477 
Ada  packages  7-009 
Ada  access  types  6-542 
Ada  visibility  6-075 
Ada  derived  types  6-075 
Ada  information  hiding  5-374 
Ada  rec  types  discrim  5-374 
Ada  task  types  4-673 
Ada  private  types  4-439 
Ada  si  ices  4-206 
Ada  overloading  3-972 
Ada  allocators  3-972 
Ada  rendezvous  3-972 
Ada  aggregates  3-972 
Ada  generic  prog  units  3-972 
Ada  entry  families  3-037 
Ada  instantiation  3-037 
Ada  short  circuiting  2.804 
Ada  elaboration  2.804 
Ada  mutual  recursion  2.804 
Ada  context  spec  2.336 
other  Ada  concepts  0.000 


The  above  list  describes  the  order  of  frequency  of  use  of  the  methodologies. 
Two  facts  stand  out  immediately.  The  first  is  that  programming  constructs  are 
most  used.  The  second  is  that  Ada  concepts  are  least  used  (preceded  by  pro- 
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gramming  concepts).  This  list  presents  a  picture  of  a  technically  knowledge¬ 
able  but  theoretically  unsophisticated  industry.  To  the  extent  that  Ada  is 
based  on  theoretical  concepts  rather  than  "standard"  programming  constructs, 
Ada  training  will  have  to  involve  theoretical  training  in  computer  science  as 
well  as  just  instruction  in  the  language. 

Programming  languages. — The  following  table  contains  programming 
languages  crosstabulated  with  proficiency  at  the  language.  The  first  count 
and  percent  are  all  proficiencies;  the  second  count  and  percent  are  people  who 
said  they  were  most  proficient  at  the  language;  the  third  count  and  percent 
are  people  who  said  they  were  most  proficient  or  second-most  proficient  at  the 
language.  The  percents  are  relative  to  respondents  (count  divided  by  1*28) • 
Proficiencies  at  Programming  Languages 
Percent  Percent 


Language 

Count 

All 

F  i  rst 

Count 

and 

Second 

JOVIAL 

89 

20.794 

15 

3.505 

CMS  2 

135 

31-542 

44 

10.280 

C 

36 

8-411 

l 

0.234 

FORTRAN 

399 

93.224 

210 

49-065 

COBOL 

206 

48-131 

36 

8.411 

ASSEMBLER 

378 

88-318 

214 

50.000 

PLI 

199 

46.495 

42 

9. 813 

PASCAL 

209 

48-832 

77 

17.991 

BASIC 

277 

64-720 

42 

9. 813 

ALGOL 

92 

21.495 

5 

1.168 

RATFOR  WATFOR  WATFIV 

95 

22.196 

0 

0.000 

M00ULA 

8 

1.869 

0 

0.000 

SIMULA 

12 

2.804 

0 

0.000 

XPL 

11 

2.570 

0 

0.000 

FORTH 

31 

7-243 

l 

0.234 

Ada 

107 

25.000 

4 

0.935 

LISP 

66 

15-421 

2 

0.467 

SN0B0L 

75 

17-523 

0 

0.000 

ECL 

3 

0.701 

0 

0.000 

GPSS 

62 

14.486 

3 

0.701 

SAS 

7 

1.636 

0 

0.000 

PROTEGE 

1 

0.234 

1 

0.234 

APL 

112 

26.168 

13 

3.037 

Other 

95 

22.196 

31 

7.243 
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The  following  list  presents  the  languages  in  order  of  percentage  of 
respondents  who  said  it  was  their  first  or  second  language  (the  sixth  column 
in  the  above  table). 


Language 

Percent  of 
Respondents 

ASSEMBLER 

50.000 

FORTRAN 

49*065 

PASCAL 

17-991 

CMS  2 

10.280 

BASIC 

9. 813 

PLI 

9- 813 

COBOL 

8.411 

Other 

7-710 

JOVIAL 

3.505 

APL 

3.037 

ALGOL 

1.168 

Ada 

0.935 

GPSS 

0  701 

LISP 

0.467 

PROTEGE 

0.234 

C 

0.234 

FORTH 

0.234 

XPL 

0.000 

SN0B0L 

0.000 

ECL 

0.000 

SIMULA 

0.000 

SAS 

0.000 

MOOULA 

0.000 

RATFOR  WATFOR 

WATFIV  0.000 

The  above  list  makes  clear  the  structure  of  the  programming  knowledge  of 
the  greatest  part  of  the  sample:  they  are  Assembler  or  FORTRAN  programmers. 
Respectively,  50  and  49  percent  of  the  respondents  rank  Assembler  and  FORTRAN 
as  their  first  or  second  language.  The  next  highest  language,  Pascal,  comes 
in  at  18  percent,  not  even  close.  Surprisingly,  languages  such  as  PL/I  are 
rather  far  down  in  the  list. 

Again,  this  structure  is  not  indicative  of  strong  theoretical  knowledge 
of  computer  science  but  rather  of  strong  practical  knowledge.  This  supports 
the  comments  above  on  methodologies.  It  would  be  unwise  to  design  an  Ada 
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training  program  that  doesn't  take  the  current,  practical  structure  of  the  in¬ 
dustry  into  account. 

Also  of  interest  are  the  relationships  between  FORTRAN  and  ASSEMBLER  and 
FORTRAN  and  BASIC.  The  above  table  noted  that  FORTRAN  and  ASSEMBLER  are  the 
two  best  known  languages;  the  following  table  displays  the  counts  of  people 
who  were  proficient  in  ASSEMBLER  for  each  other  language  at  which  they  were 
proficient. 


Count 


Other  Language 

Percent 

FORTRAN 

101 

49.510 

PASCAL 

27 

13.235 

CMS  2 

17 

8.333 

COBOL 

15 

7-353 

PLI 

12 

5.882 

BASIC 

10 

4.902 

Other 

10 

4.902 

APL 

5 

2.451 

JOVIAL 

4 

1.96: 

GPSS 

1 

0.490 

FORTH 

1 

0.490 

ALGOL 

1 

0.490 

This  table  indicates  that  people  who  use  ASSEMBLER  usually  use  FORTRAN — 50 
percent  of  the  people  who  picked  one  picked  the  other  as  languages  in  which 
they  were  proficient.  Pascal  came  in  next,  but  wasn't  close. 

The  following  table  gives  the  counts  and  percentages  of  people  who  ranked 
only  FORTRAN  (without  BASIC),  only  BASIC  (without  FORTRAN),  both  together,  or 
neither,  in  their  choices  for  first  or  second  proficiency. 


Count 

Percent 

FORTRAN  only 

189 

44.3 

BASIC  only 

21 

4.9 

both 

21 

4.9 

nei ther 

196 

45-9 

1094-2 


0-26 


Ada  Workforce  Survey 


Page  25- 


From  this  frequency  table,  it  would  appear  that  BASIC  and  FORTRAN  knowledge 
are  quite  Independent;  those  who  use  FORTRAN  generally  don't  use  BASIC  as 
their  other  language,  and  those  who  use  BASIC  half  the  time  don't  use  FORTRAN. 
This  applies  only  to  languages  ranked  with  first  and  second  proficiency  rat- 
i  ngs. 

Relationships. — The  following  paragraphs  address  some  topics  of  interest 
relating  to  relationships  between  some  of  the  information  presented  above.  I 
will  consider  six  such  relationships:  (1)  Ada  involvement  and  knowledge  of 
Ada  concepts;  (2)  Ada  training  and  knowledge  of  Ada  concepts;  (3)  various 
interrelationships  between  belonging  to  technical  societies,  publishing  or 
presenting  papers,  technical  reading,  and  going  to  conferences;  (k)  areas  of 
experience  and  knowledge  of  concepts;  (5)  years  of  experience  and  programming 
languages;  and  (6)  Ada  training  and  years  of  experience  for  those  who  know 
Ada. 

To  study  the  relationship  between  involvement  with  the  Ada  language  and 
knowledge  of  Ada  concepts,  a  measure  of  knowledge  was  constructed  by  summing 
the  knowledge  scores  over  the  Ada  concepts  and  dividing  by  the  number  of  ele¬ 
ments;  this  produces  an  average  score  of  knowledge  of  Ada  concepts  for  each 
respondent.  A  measure  of  Ada  involvement  was  constructed  by  equating  "other" 
involvement  to  "training"  so  as  to  make  a  continuous  scale.  Knowledge  was 
regressed  on  involvement,  obtaining  the  following  regression  equation: 

knowledge  ■  -0.075  +  0*575  *  involvement  +  e 

(0.059) 

That  is,  the  value  of  the  knowledge  measure  for  a  given  individual  is  equal  to 
the  involvement  measured  multiplied  by  .575  plus  a  constant  (-.075)  plus  a 
random  error.  .575  is  known  as  the  "coefficient"  for  involvement.  The  coef- 
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ficient  for  involvement  was  significant  at  the  99-9  percent  level.  The  re¬ 
gression  equation  was  also  significant,  since  there  was  only  one  coefficient. 
The  coefficient  of  determination  (R  squared)  was  0.1 85 •  indicating  that  only 
19  percent  of  the  variance  in  knowledge  is  explained  by  involvement.  This  re¬ 
sult  indicates  that  although  involvement  has  some  effect  on  knowledge,  that 
effect  isn't  very  large. 

A  similar  approach  was  taken  to  the  comoarison  of  Ada  training  techniques 
to  knowledge  of  Ada  concepts.  The  same  measure  of  knowledge  was  used,  but  in¬ 
stead  of  regression,  analysis  of  variance  was  used,  since  the  Ada  training 
attribute  is  nominal  in  scale,  not  interval.  The  analysis  of  variance  was  not 
significant;  that  is,  the  variation  was  too  unreliable  to  enable  any 
conclusions.  This  is  probably  due  to  the  relatively  small  number  of 
respondents  who  have  been  trained  in  Ada  or  who  have  knowledge  of  Ada. 

Since  all  of  the  attributes  involving  professional  activities  were  nomi¬ 
nal,  all  of  these  comparisons  were  made  as  contingency  tables.  None  of  the 
tables  had  valid  chi  squire  statistics  due  to  either  zero  marginals  or  small 
cell  expectations.  Therefore,  no  conclusions  have  been  drawn  as  to 
relationships  between  these  variables.  However,  the  four-way  table  below 
presents  the  frequencies  of  these  attributes  for  what  they  are  worth.  Each  of 
the  tables  represents  a  "slice"  of  the  four-way  table  for  one  combination  of 
the  conference  attendance  and  publishing  attributes. 
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conference  attendance,  published  or  presented: 
yes,  yes 


technical  societies 


yes 

no 

technical  reading  extent 

regularly 

33 

8 

occasional 1y 

8 

7 

only  as  my  job  demands 

0 

0 

never 

0 

0 

other 

0 

0 

yes,  no 

technical  societies 


yes 

no 

technical  reading  extent 

regularly 

31 

33 

occasional ly 

10 

32 

only  as  my  job  demands 

2 

6 

never 

0 

1 

other 

0 

0 

no,  yes 

technical  societies 


technical  reading  extent 

yes 

no 

regularly 

16 

7 

occasional ly 

3 

10 

only  as  my  job  demands 

0 

3 

never 

0 

0 

other 

no,  no 

0 

0 

technical  societies 


technical  reading  extent 

yes 

no 

regularly 

20 

35 

occasional ly 

16 

99 

only  as  my  job  demands 

2 

19 

never 

0 

12 

other 

0 

2 

There  was  no  significant  relationship  between  areas  of  experience  and 
knowledge  of  concepts,  meaning  that  no  conclusions  may  be  drawn  statistically 
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about  this  relationship. 

Because  years  of  involvement  can  be  considered  scaled,  an  analysis  of 
variance  was  performed  with  that  attribute  as  the  response  variable  and  pro¬ 
gramming  language  as  the  factor.  The  model  was  not  significant,  and  no 
conclusions  may  be  drawn  as  to  the  relationship.  The  following  table  presents 
the  counts  for  the  crosstabulation;  it  has  no  valid  chi  square  statistic  due 
to  zero  marg i na 1 s. 

years  of  involvement 


f  i  ve 

to  ten 

years 

two  to 

f  i  ve 

years 

less 

than  two 

years 

over 

ten  years 

language 

JOVIAL 

5 

12 

12 

58 

87 

CMS  2 

7 

22 

26 

78 

133 

C 

5 

11 

5 

15 

36 

FORTRAN 

36 

91 

81 

187 

395 

C03CL 

12 

46 

39 

105 

202 

ASSEMBLER 

31 

83 

76 

184 

374 

PLI 

11 

53 

43 

88 

195 

PASCAL 

28 

64 

37 

78 

207 

BASIC 

25 

71 

50 

128 

274 

ALGOL 

8 

20 

16 

48 

92 

RATFOR  WATFOR 

WATF 1 V 

14 

27 

21 

33 

95 

MODULA 

0 

3 

4 

1 

8 

SIMULA 

0 

1 

6 

5 

12 

XPL 

1 

4 

2 

4 

11 

MMP 

0 

0 

0 

0 

0 

FORTH 

1 

8 

6 

16 

31 

Ada 

7 

26 

11 

62 

106 

LISP 

9 

21 

16 

20 

66 

SNOBOL 

8 

24 

19 

24 

75 

ECL 

0 

0 

1 

2 

3 

GPSS 

2 

12 

14 

33 

61 

SAS 

0 

2 

3 

2 

7 

PROTEGE 

0 

1 

0 

0 

1 

PPL 

0 

0 

0 

0 

0 

APL 

13 

28 

26 

45 

112 

Other 

5 

19 

23 

47 

94 

228 

649 

537 

1263 

2677 

The  following  table  combines  the  lesser-known  programming  languages  into 
a  residual  category  and  has  a  significant  chi  square  statistic. 
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years  of  involvement 


five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 


1 anguage 
JOVIAL 

5 

12 

12 

58 

87 

CMS  2 

7 

22 

26 

78 

133 

FORTRAN 

36 

91 

81 

187 

395 

COBOL 

12 

1*6 

39 

105 

202 

ASSEMBLER 

31 

83 

76 

181* 

371* 

PLI 

11 

53 

U3 

88 

195 

PASCAL 

28 

6A 

37 

78 

207 

BASIC 

25 

71 

50 

123 

271. 

Other 

73 

207 

173 

357 

810 

228 

61.9 

537 

1263 

2677 

Finally,  the  relationship  between  Ada  training  and  years  of  involvement 
is  presented  in  the  following  table.  This  table  has  no  valid  chi  square  value 
due  to  low  cell  expectations.  It  does  show,  however,  that  a  large  portion  of 
the  people  who  know  Ada  are  people  i r.  the  industry  for  over  ten  years.  These 
are  the  people  who  tend  to  know  more  programming  languages  as  well.  The 
training  doesn't  seem  to  show  any  pattern  different  from  the  usual  pattern  for 
any  group — seminars,  in-house  courses,  and  informal  training  account  for  most 
of  the  training  in  all  categories. 

years  of  involvement 

five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 

Ada  training 


videotape 

2 

5 

0 

9 

16 

college  course 

0 

3 

0 

1* 

7 

in  house  course 

6 

li* 

3 

23 

1*6 

programmed  learning 

0 

3 

0 

2 

5 

semi nar 

2 

9 

5 

27 

A3 

informal  training 

5 

11 

7 

28 

51 

other 

2 

i« 

5 

10 

21 

17 

1*9 

20 

103 

189 
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C ! ass i f i cat i on  of  the  Workforce 

Methods .--Before  giving  the  results,  the  report  will  summarize  briefly 
the  problems  faced  in  classifying  the  respondents.  The  goal  was  to  induce 
some  classification  scheme  based  on  job  outputs,  principal  duties,  and  general 
activities  that  reflects  a  meaningful  categorization  of  the  workforce. 

The  first  problem  was  that  the  basic  variables  were  nominal  or  catego¬ 
rized  variables,  variables  with  no  inherent  ordering  between  values.  This 
meant  that  none  of  the  classification  techniques  such  as  discriminant  analysis 
or  metric  distance  clustering  would  be  appropriate,  since  they  are  all  based 
on  metric  data. 

Second,  the  data  was  multiple  response.  Each  of  the  three  questions  had 
3  d; *f erant  number  cf  responses.  This  meant  that  the  judgment  of  similarity 

would  have  to  take  into  account  the  range  of  possible  values,  making  the  judg¬ 
ment  relative  to  all  the  possibilities. 

Third,  the  general  activities  were  all  rated  as  to  importance.  It  would 
have  been  useful  to  incorporate  this  information  into  the  judgment  of  similar¬ 
ity  in  some  way  in  that  it  probably  w  uld  have  eliminated  some  of  the  noise  in 
the  classification.  These  measures  were  not  used  in  the  following  analysis, 
however;  there  is  reason  to  believe  that  including  them  would  not  have  made 
much  difference.  The  methods  used  below  are  not  particularly  sensitive  to 
even  moderate  changes  in  the  measurement  of  similarity. 

Fourth,  there  are  a  very  large  number  of  response  values,  111*,  to  be  con¬ 
sidered.  The  size  of  the  conceptual  area  to  be  integrated  is  well  beyond  the 
capability  of  the  human  mind  to  comprehend.  Nobody  can  look  at  111*  different 
repsonse  values  and  judge  differences.  There  needs  to  be  some  method  of 
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summarizing  the  information  into  a  smaller  conceptual  area. 

The  method  chosen  involves  five  steps:  (1)  expand  the  data  to  take  into 
account  all  possible  responses,  not  just  those  actually  responded; 

(2)  calculate  a  similarity  coefficient  based  on  pattern  matching;  (3)  cluster 
the  respondents  based  on  the  similarity  measure;  (A)  determine  the  optimal 
number  of  clusters  by  taking  various  cross-sections  of  the  tree  and  analyzing 
them;  and  (5)  use  median  polishing  to  produce  an  interpretation  of  the  optimal 
cluster  pattern. 

The  original  data  is  in  the  form  of  a  table  where  rows  are  individuals 
and  columns  are  responses.  The  values  of  the  table  cells  are  zeros  and  ones, 
a  zero  indicating  the  response  was  not  give,,,  a  one  indicating  that  it  was. 

The  string  of  zeros  and  ones  represents  the  pattern  of  the  individual  's 
reponses . 

For  a  given  pair  of  individuals,  the  patterns  are  compared,  one  column  at 
a  time.  If  each  has  a  one,  or  if  each  has  a  zero,  the  individuals  are  more 
similar.  If  the  two  values  are  different,  the  individuals  are  less  similar. 
Mathematically,  the  measure  of  similarity  is  calculated  using  the  following 
table: 

1  0 

1  a  b 
0  c  d 

"a"  represents  the  count  of  positive  matches--where  both  individuals  have 
ones,  "d"  represents  the  count  of  negative  matches — where  both  individuals 
have  zeros,  "b"  and  "c"  are  the  counts  of  nonmatches.  Similarity  is  a  +  d  / 
(a  +  b  +  c  +  d)  .  That  is,  similarity  is  the  number  of  matches  divided  by  the 
number  of  possible  matches.  Similarity  varies  between  zero  and  one,  where  ze¬ 
ro  means  completely  dissimilar,  and  one  means  completely  similar. 
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The  similarity  program  produces  a  square  matrix  of  similarity 
coef f ic i ents--each  individual  compared  to  each  other  individual.  The  matrix 
is  n  by  n,  where  n  is  the  number  of  individuals.  This  is  similar  to  a  corre¬ 
lation  matrix. 

The  similarity  matrix  is  input  to  the  clustering  program.  Hierarchical 
clustering  is  a  process  that  starts  with  all  individuals  separated  and  pro¬ 
ceeds  to  group  the  individuals  into  larger  and  larger  clusters,  finally 
resulting  in  one  large  cluster.  The  diagram  produced  by  the  program  resembles 
a  tree.  At  each  level  of  the  tree,  another  individual  is  clustered;  thus  if 
there  are  n  individuals,  there  will  be  n  -  1  levels  in  the  tree. 

When  a  given  individual  is  clustered  with  another,  that  cluster  becomes 
an  individual  for  the  purposes  of  the  next  clustering.  Therefore,  the  simi¬ 
larity  matrix  needs  to  be  adjusted;  one  individual  is  removed,  and  the 
similarities  between  the  new  individual  (the  last  cluster  produced)  and  all 
the  other  individuals  (or  clusters)  has  to  be  recalculated.  The  difference 
between  different  methods  of  clustering  is  based  on  how  to  recalculate  these 
similarities.  The  technique  used  below  calculates  the  similarity  as  the  mini¬ 
mum  of  the  similarities  between  the  individuals  in  the  new  cluster  and  the 
individuals  in  the  cluster  to  which  the  new  cluster  is  being  compared. 

For  example,  say  you  have  five  individuals.  At  the  third  level,  1  and  5 
are  together  in  a  cluster,  3  and  4  are  together  in  another  cluster,  and  2  is 
still  an  individual.  The  new  similarity  matrix  would  be  a  3  by  3  matrix, 
since  there  are  now  only  three  individuals.  The  similarity  of  1  and  5  to  3 
and  1 *  would  be  the  smallest  of  the  four  similarities,  1  to  3,  1  to  4,  5  to  3, 
or  5  to  4.  This  clustering  method  is  not  sensitive  to  the  measurement  level 
of  the  original  data;  since  the  data  is  composed  of  zeros  and  ones  in  an 
unordered  secuence,  such  an  insensitive  method  is  more  appropriate  than  other 
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methods  involving  averages  or  weighted  averages  of  similarities. 

Once  the  cluster  tree  has  been  produced,  it  must  be  interpreted.  The 
first  problem  is  to  figure  out  where  to  cut  the  tree;  that  is,  to  determine 
how  many  disjoint  clusters  are  most  appropriate  or  most  meaningful.  There  is 
no  generally  agreed-upon  method  for  doing  this.  The  next  problem  is  to  pro¬ 
duce  a  meaningful  interpretation  of  the  disjoint  clusters  selected. 

Using  the  interpretive  method  discussed  below,  five  clusters  were  select¬ 
ed.  The  following  table  lists  the  number  of  respondents  in  each  cluster;  the 
list  does  not  sum  to  1*28.  since  several  individuals  were  removed  from  the 
analysis  due  to  excessive  missing  values  (no  job  outputs  or  principal  duties 
and  so  forth) . 


Cluster 

Counts 

Percents 

cluster  2 

UG 

11.7 

cluster  3 

169 

1*2.9 

cluster  5 

135 

34.2 

cluster  38 

14 

3.6 

cluster  57 

30 

7.6 

Since  the  response  structure  is  so  large,  it  is  necessary  to  summarize 
the  information  in  some  way.  The  approach  used  below  is  called  median 
pol ish ing. 

Median  polishing  begins  with  a  table  of  values.  In  this  case,  the  table 
is  a  crosstabulation  of  cluster  versus  the  several  responses;  that  is,  it  is  a 
5  by  111*  table,  5  clusters,  111*  possible  responses.  The  cells  of  the  table 
are  counts — how  many  individuals  in  the  cluster  responded  with  the  particu'ar 
response. 

Median  polishing  is  the  process  of  repeatedly  substracting  the  median 
values  of  the  rows  and  columns  of  the  table  from  the  cells  of  the  table.  For 
example,  say  there  was  a  3  by  3  table  such  as  the  following: 
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a  b  c 

x  3  6  2 

y  5  2  l 

2192 


The  first  step  is  to  take  the  medians  of  the  rows:  3.  2,  2.  These  numbers 
are  subtracted  from  the  values  in  the  rows,  giving  the  following  table: 
row 

a  b  c  med 

x  0  3  -1  3 

y  3  0  -1  2 

r  -1  7  0  2 


The  next  step  is  to  repeat  this  process  for  the  columns;  in  addition,  the  me¬ 
dian  of  the  row  medians  (2  in  this  case)  is  subtracted  from  the  row  medians 
and  is  placed  in  the  lower  right-hand  corner  of  the  table, 
row 

a  b  c  med 

x  0  3-1  1 

y  3  0-1  0 

2-170  0 
col 

med  00-1  2 


The  process  is  repeated  once  more  for  the  rows,  this  time  subtracting  the  me¬ 
dian  of  the  column  medians  from  the  column  medians  as  well  as  adding  the  new 
row  medians  to  the  old  medians. 


row 

a  b  c  med 

x  03-1  1 

y  3  0-1  0 

2-170  0 
col 

med  00-1  2 
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At  this  point,  all  the  new  row  medians  are  zero,  so  nothing  changes.  The  fi¬ 
nal  pass  repeats  the  column  median  polish, 
row 

a  b  c  med 

x  0  3-1  1 

y  3  0-1  0 

2-17-2  0 

col 

med  00-2  2 

At  this  point,  little  change  will  happen  with  additional  passes,  although 
the  process  may  be  continued  until  no  change  occurs.  There  are  now  four 
components  to  the  polished  table,  the  row  and  column  medians,  the  median  of 
the  medians,  and  the  table  of  left-over  val-es.  These  are  termed,  respective¬ 
ly,  row  and  column  effects,  common  effect,  and  residuals.  In  the  case  of  the 
table  used  in  the  classification  interpretation,  the  effects  represent  expec¬ 
ted  si2es  of  cells  in  the  table  of  counts  given  a  simple  additive  model, 

cell  count  *  common  +  row  +  column  +  residual. 

That  is,  the  count  in  a  particular  cell  (the  conjunction  of  a  cluster  and  a 
particular  response)  is  the  sum  of  the  common  effect,  the  cluster  effect,  the 
response  effect,  plus  the  residual.  For  a  more  detailed  explanation  of  median 
polishing,  consult  the  references  given  in  Appendix  3* 

The  larger  the  particular  effect,  the  larger  the  influence  of  that  clus¬ 
ter  or  value  on  the  cell  value.  Thus  the  row  effects  indicate  the  influence 
of  cluster  membership  on  the  expected  frequency  of  picking  a  particular  re¬ 
sponse,  and  the  column  effects  indicate  the  influence  of  a  particular  response 
on  the  expected  frequency  of  a  cluster's  members  picking  the  response.  But 
the  residuals,  the  table  of  values  left  over,  provide  a  much  more  interesting 
thing--a  measure  of  unusualness.  A  cell  residual,  compared  to  other  cell 
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c!uster2 
cluster3 
c iuster5 
c1uster38 
ciuster57 


11.500 

1*6-500 

0.000 

-13.500 

-7.500 


hard  soft  tradeoff  eval 
data  flow  diagrams 
test  drivers 
jo  code 

prog  design  language 
requirements  specs 
design  specs 
test  plans 
integration  plans 
management  plans 
cost  data 
analysis  reports 
mi lestone  charts 
status  reports 
interview  sheets 
correspondence 
development  other 
STR  analyses 
temp  ECPs 

red ’ ' nod  documentation 
support  test  plans 
support  test  drivers 
jo  tech  advice  to  CCB 
updated  NIL  STD  spec 
jo  library  control 
maintain  config  procs 
updated  training  manuals 
updated  user  manuals 
STRs 

automated  build  systems 
management  info  reports 
version  descrip  docs 
version  audi ts 
field  engineering  report 
support  other 
conduct  req  review 
attend  req  review 
system  analysis 
des ' gn 

conduct  design  review 
attend  design  review 
pd  code 

conduct  walkthroughs 
attend  walkthroughs 
formulation  of  policy 
formulation  of  strategy 
pd  technical  management 


0.000 
13.000 
8-500 
15-000 
U.000 
19.500 
21.000 
15.000 
7.500 
7.000 
6.000 
3.000 
9.000 
11*.  000 
6.000 
-1.000 
-II.5OO 
-2.000 
-13.500 
-P..000 

-5.000 

-10.500 

-13.500 
-11*.  500 
-11.500 
-10.500 
-id. 500 
-3.000 
-1*.000 
-11.500 
-10.500 
-13.500 
-16. 500 
-16-500 
-8.500 
-3.500 

8.000 

16.000 

17.000 

8-500 

8.000 

6.000 

-1.500 

1.000 

-8.000 

-i*.000 

6.000 
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residuals  in  a  column,  indicates  the  relative  unusua 1  ness  of  the  cluster  with 
respect  to  the  other  dusters  on  the  particular  response.  Thus  if  one  cluster 
has  a  much  higher  residual  for  one  response  than  the  other  clusters,  that 
cluster  has  given  that  response  relatively  more  often;  conversely,  a  high  neg¬ 
ative  residual  means  the  cluster  gave  that  response  less  often. 

Given  this  interpretation  of  the  residuals,  it  is  straightforward  to  rank 
the  residuals  in  each  column  in  ascending  and  descending  order.  These  ranks 
represent  the  relative  unusualness  of  the  cluster  with  respect  to  that  re¬ 
sponse,  The  next  step  is  to  collect  the  instances  where  the  cluster  was 
ranked  1  or  2  (and  possibly  3):  this  indicates  on  which  responses  the  cluster 
was  unusual.  There  are  two  groups  of  rank:,  for  each  cluster,  positive  high 
ranks  and  negative  high  ranks.  These  show,  respectively,  what  the  clusters  do 
do  unusually  and  what  they  don't  do  unusally.  Thus,  the  comparison  of  the 
ranks  gives  a  direct  interpetation  of  the  patterns  of  the  clusters'  responses. 

Applied  to  the  decision  about  how  many  clusters  to  pick,  this  approach  is 
tried  for  several  different  numbers  of  clusters,  and  the  best  or  most  inter- 
pretable  number  is  chosen.  Applied  to  this  final  choice,  the  method  gives  a 
summary  interpretation  of  the  patterns  of  the  clusters. 

The  results. — Given  all  that,  the  following  is  the  final  interpretive  me¬ 
dian  polish  for  the  optimal  cluster  pattern,  which  involves  five  clusters. 

The  rankings  are  from  1  to  2;  values  of  1.5  indicate  ties  at  the  first 
rank'-the  highest  or  lowest  residuals  in  a  given  column  were  the  same. 

Cluster  Structure  using  All  Job  Outputs,  General 
Activities,  and  Principle  Duties 

Effects  and  Typicals  after  Polishing 

effects 

common  16.500 
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pd  program  management 
conf i gurat I  on  management 
pd  quality  assurance 
monitoring  contracts 
other  development 
support  analysis 
support  design 
conduct  support  dr 
attend  support  dr 
code  patch 

conduct  sup  walkthrough 
attend  sup  walkthrough 
sup  technical  management 
sup  policy  formulation 
sup  program  management 
SCC3  participation 
sup  config  management 
sup  quality  assurance 
sup  monitoring  contracts 
other  support 
ga  program  management 
sales  marketing 
contract  negotiation 

f or mu  1  a 1 1  ng  po  1 1  c y 
formulating  strategy 
Preparing  budgets 
ga  technical  management 
interviewing  personnel 
preparing  schedules 
preparing  mgmt  info  rpts 
preparing  fid  eng  rpts 
other  admin  tasks 
ga  tech  advice  to  CCB 
maint  config  procs 
9a  library  control 
prep  version  audits 
ga  quality  assurance 
prep  temp  eng  change  rpt 
prep  technical  rpts 
reading  tech  pubs 
reviewing  tech  work 
teach i ng 

updating  training  manual 
being  fa i red 
func  system  design 
func  module  design 
def  global  data  strucs 
def  subsystem  interface 
de#  stuff  for  own  use 
cea  i  ng 

debugging  or  modifying 
preo  sys  rqt  docs 
updating  rtlL  STC  specs 


*15.500 
*12.500 
*10.500 
-12.500 
-10.500 
0.000 
-2.000 
-9-500 
-3.000 
-2.000 
-12.500 

-7.000 
-11.500 
-16.500 
-15.500 
-13.500 
-10.500 
-13.500 
-10.500 
-9.500 
-4.000 
-2.000 
-I*  .000 
-2.000 
5*000 
9.000 

15. 000 

9-000 
15.000 
10.000 
-14.500 
6.000 
3.000 
2.000 
-5.500 
-8- COO 
0.000 
-2.000 
16.000 
18-000 
18.000 
14.000 
0.000 
12.000 
17.000 
35.000 
13-000 
16.000 
11.000 
6.000 
7.000 
17.000 
-3.000 
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prep  redlined  docs  5*000 
prep  version  descr  mnls  3-000 
prep  user  manuals  6-000 
documenting  code  2.000 
defining  test  cases  10.000 
prep  test  drivers  3.000 
prep  test  plans  10.000 
hardware  testing  0.000 
system  software  test  9-000 
defining  mod  test  cases  3.000 
software  module  testing  0.000 
documenting  test  results  2.000 
prep  trouble  reports  4.000 
analyzing  trouble  rpts  4.000 
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test  drivers  design  specs 

data  flow  diagrams  prog  design  language 


hard  soft  tradeoff  eval 

jo  code 

requi rements 

specs  test  plans 

cluster  2 

7.000 

-10.000 

-16. 500 

-12.000 

-14.000 

-8.500 

-7 .000 

-9.000 

cluster3 

-14.000 

18-000 

10.500 

63.000 

55-000 

26.500 

48.000 

37.000 

clusters 

-2.500 

14.500 

0.000 

54.500 

41.500 

•  .000 

5.500 

25.500 

cluster38 

0.000 

-15.000 

-10.500 

-18.000 

-17.000 

-18-500 

-24.000 

-17-000 

cluster57 

9.000 

0.000 

1.500 

0.000 

0.000 

0.500 

0.000 

0.000 

analysis  reports 

interview  sheets 

management  plans 

status  reports 

i ntegration 

plans 

cost  data  milestone  charts 

correspondence 

cluster2 

-5-500 

2.000 

0.000 

0.000 

3.000 

0.000 

0.000 

0.000 

cluster3 

10.500 

-48-000 

-44.000 

-29.000 

0.000 

23.000 

-25.000 

-30.000 

clusters 

0.000 

-13.500 

-10.500 

-8-500 

-4.500 

12.500 

-10.500 

-7.500 

cluster38 

-9.500 

2.000 

1.000 

1.000 

-1.000 

-6.000 

0.000 

10.000 

cluster57 

6.500 

0.000 

7.000 

10.000 

8.000 

0.000 

0.000 

4.000 

redlined  documentation 

jo  tech  advice 

to  CCB 

STR  analyses 

support  test  drivers 

development  other 

temp  ECPs  support  test 

plans 

updated 

MIL  STD  spec 

cluster2 

-14.500 

-21.000 

-13.500 

-19.000 

-21.000 

-15.500 

-12.500 

-13.500 

cluster3 

-46-500 

0.000 

-13.500 

-19.000 

-12.000 

-29.500 

-22.500 

-35.500 

clusters 

0.000 

4.500 

0.000 

1.500 

3.500 

0.000 

0.000 

0.000 

c  Iuster38 

9-500 

4.000 

13.500 

7-000 

4.000 

9.500 

14.500 

12.500 

cluster57 

3.500 

-3-000 

6-500 

0.000 

0.000 

6.500 

7.500 

8.500 
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updated 

tra i n i ng 

manua  1  s 

automated  build  systems 

maintain  config  procs 

STRs 

version  descrip  docs 

jo  1 ibrary  control 

updated 

user  manuals 

management  info  reports 

cluster2 

-15-500 

-14.500 

-15.500  - 

20.000 

-20.000 

-14.500  -16. 500  -II.500 

c1uster3 

-35-500 

-34.500 

-38.500  - 

20.000 

-5.000 

-40.500  -36-500  -39-500 

cluster5 

0.000 

0.000 

0.000 

4.500 

3-500 

0.000  0.000  0.000 

cluster38 

9-500 

10.500 

7.500 

0.000 

5.000 

8.500  12.500  12.500 

cluster57 

4.500 

2.500 

3.500 

1.000 

0.000 

3.500  4.500  6.500 

conduct  req  review 

conduct  design  review 
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system  analysis 
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-17.000  -20.000  -13.500 

cluster3 
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-40.500 

-49.500  - 

19.500 

3-000 

19.000  56.000  7.500 
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0.000 

0.000 

0.000 

0.000 

2.500 

3-500  43.500  0.000 

cluster38 

15.500 

13.500 

7.500 

1.500 

-5-000 

-18.000  -20.000  -10.500 
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9.500 

8-500 

0.500 

10.500 

0.000 

0.000  0.000  0.500 

conduct  walkthroughs 

formulation  of  strategy 

pd  code 
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policy  pd  program  management 

attend  design 

review 
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walkthroughs 

pd  technical  management 

Cluster2 
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other  support  contract  negotiation 

sup  monitoring  contracts  sales  marketing  formulating  strategy 
sup  quality  assurance  ga  program  management  formulating  policy 

cluster2  -11*. 500  -17-500  -17.500  10.000  0.000  3.000  11*. 000  10.000 

cluster  -33.500  -1*3-500  -48-500  -16-000  -44-000  -39-000  -24-000  -12.000 
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cluster2 
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cluster3 
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version 
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73-000 

71.000 

cluster5 

31.500 

31.500 

c 1 uster  38 

-5.000 

-6.000 

cluster57 

-7.000 

-3.000 

Categor i es 

with  High  Pos i t i 

ve 

Categor i es  with 

High  Negative 

Residua 

Is  in  Rank  Order 

Residuals  in 

Rank  Order 

Cluster  2 


updating  training  manuai 

1 .000 

hardware  testing 

1 . 000 

ga  quality  assurance 

1.000 

test  drivers 

1 .000 

formulating  pol icy 

1.000 

attend  design  review 

1.000 

interviewing  personnel 

1.000 

conduct  design  review 

1.000 

formulating  strategy 

1.000 

attend  walkthroughs 

1.000 

ga  tech  advice  to  CCB 

1.500 

attend  req  review 

1.000 

management  plans 

1.500 

support  analysis 

1.000 

pd  technical  management 

1.500 

support  design 

1.000 

contract  negotiation 

2.000 

STRs 

1 .000 

formulation  of  strategy 

2.000 

support  test  plans 

1.000 

preparing  budgets 

2.000 

code  patch 

1.000 

ga  technical  management 

2.000 

STR  analyses 

1.000 

interview  sheets 

2.000 

attend  support  dr 

1.000 

preparing  schedules 

2.000 

conduct  walkthroughs 

1.000 

preparing  mgmt  info  rpts 

2.000 

pd  code 

1.000 

mi  1 estone  charts 

2.000 

temp  ECPs 

1.500 

maint  config  procs 

2.000 

red  1 i ned  documentat i on 

1.500 

ga  library  control 

2.000 

updated  user  manuals 

1.500 

ga  program  management 

2.000 

ces i gn 

1.500 

hard  soft  tradeoff  eval 

2.000 

updated  MIL  STD  spec 

2.000 

jo  1 i brary  control 

2.000 

automated  build  systems 

2.000 

integration  plans 

2.000 

test  plans 

2.000 

vers i on  aud i ts 

2.000 

field  engineering  report 

2.000 

suoport  other 

2.000 

conduct  req  review 

2.000 
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Cluster 


data  flow  diagrams 

.000 

test  drivers 

.000 

jo  code 

.000 

prog  design  language 

.000 

requirements  specs 

.000 

design  specs 

.000 

test  plans 

.000 

integration  plans 

.000 

status  reports 

.000 

attend  req  review 

.000 

system  analysis 

.000 

des i gn 

.000 

conduct  design  review 

.000 

prep  red  lined  docs 

.000 

updating  MIL  STD  specs 

.000 

conduct  walkthroughs 

000 

debugging  or  modifying 

000 

preparing  budgets 

000 

ga  technical  management 

000 
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design  specs 

2.000 

requirements  specs 

2.000 

development  other 

2.000 

prog  design  language 

2.000 

jo  code 

2.000 

jo  tech  advice  to  CCB 

2.000 

support  test  drivers 

2.000 

system  analysis 

2.000 

pd  program  management 

2.000 

configuration  management 

2.000 

pd  quality  assurance 

2.000 

monitoring  contracts 

2.000 

other  development 

2.000 

version  descrip  docs 

2.000 

management  info  reports 

2.000 

conduct  support  dr 

2.000 

updated  training  manuals 

2.000 

maintain  config  procs 

2.000 

conduct  sup  walkthrough 

2.000 

attend  sup  walkthrough 

2 .000 

sup  technical  management 

2.000 

sup  policy  formulation 

2.000 

sup  program  management 

2.000 

SCCB  participation 

2.000 

sup  config  management 

2.000 

sud  quality  assurance 

2.000 

sup  monitoring  contracts 

2.000 

other  support 

2.000 

preparing  fid  eng  rpts 

2.000 

updating  MIL  STD  specs 

2.000 

data  flow  diagrams 

2.000 

3 


hard  soft  tradeoff  eval 

1.000 

management  plans 

1 .000 

cost  data 

1.000 

analysis  reports 

1.000 

interview  sheets 

1.000 

correspondence 

1.000 

development  other 

1.000 

ga  program  management 

1.000 

other  support 

1.000 

sup  monitoring  contracts 

1.000 

support  test  drivers 

1.000 

jo  tech  advice  to  CCB 

1.000 

updated  MIL  STD  spec 

1.000 

jo  1 ibrary  control 

1.000 

maintain  config  procs 

1.000 

updated  training  manuals 

1.000 

attend  sup  walkthrough 

1.000 

conduct  sup  walkthrough 

1.000 

automated  build  systems 

1.000 
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preoaring  sc'edules 
Prepar i ng  mcmt  info  rpts 
func  module  design 
func  system  ces i gn 
maint  con*ig  procs 
prep  temp  erg  change  rpt 
prep  technical  rpts 
reading  tech  pubs 
reviewing  tech  work 
teaching 
being  trained 
documenting  test  results 
software  module  testing 
def  global  data  strucs 
def  subsystem  interface 
def  stuff  for  own  use 
cod i ng 

prep  test  drivers 
prep  user  manuals 
documenting  code 
prep  sys  rqt  docs 
prep  version  descr  mnls 
defining  test  cases 
prep  test  plans 
hardware  testing 
svstem  S5*tw3r»  test 
defining  mod  test  cases 
prep  trouble  reports 
analysing  trouble  rpts 
ga  tech  advice  to  CCB 
pd  code 

attend  design  review 
attend  walkthroughs 
other  admin  tasks 


attend  design  review 
attend  walkthroughs 
support  analysis 
support  design 
attend  support  dr 
updated  user  manuals 
STR  analyses 
pd  code 
code  patch 
status  reports 
test  plans 
design  specs 
prog  des:cr.  'anguage 
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1.000 
1 .000 
1.000 
1 .000 
1.000 
1.000 
1 . 000 
1  .oco 
1 .000 
1.000 
1 .000 
1.000 
1 .000 
1 .000 
l.COO 
1.000 
1.000 
1.000 
1 .000 
1 .000 
1.000 
1.000 
1.000 
1.000 
1.000 
1.00C 

1 . 000 
1.000 
1 . 000 
1.500 
2.000 
2.000 
2.000 
2.000 


Cluster 


management  info  reports 
version  descr i o  docs 
ver s i on  aud i is 
field  engineering  report 

suopo^t  other 
conduct  req  ’“eview 
formu I  at » on  of  policy 
formulation  of  strategy 
od  technical  management 
pd  program  management 
configuration  management 
pc  quality  assurance 
monitoring  contracts 
other  development 
sales  marketing 
sud  quality  assurance 
sup  technical  management 
SCCS  participation 
sup  program  management 
sup  policy  formulation 
conduct  support  dr 
sup  corfig  management 
prep  version  audits 
ga  I  ibrary  control 
preparing  flq  eng  rpts 

-  ■  "  ‘ .  •  -  - 
formulating  policy 

contract  negotiation 

rediined  documentation 

temp  ECPs 

updated  user  manuals 
support  analysis 
support  test  plans 
support  design 
attend  support  dr 
code  patch 
STRs 

5 


1.000 
l.COO 
1.000 
1 .000 
1 .000 
1 .000 
1.00C 
l.COO 
1 .000 
2.000 
2.000 
2.000 
2.000 


updating  Mil  STj)  specs 
ga  technical  management 
interviewing  personnel 
prepar>r.g  schedules 
other  admin  tasks 
mi  1 estone  charts 
ga  tech  advi ce  to  CCB 
preparing  mgmt  info  rpts 
interview  sheets 
analysis  reports 
cost  data 
management  plans 
cont-act  neget i at  1  on 


1.000 
1.000 
1.000 
1.000 
1 .000 
1.000 
1.000 
1.000 
1 .000 
1.000 
1.000 
1.000 
1.000 
1 .000 
1.000 
1  .000 
1.000 
1.000 
1  .000 
1 .000 
1.000 
1  .000 
1.000 
1.000 
1.000 

1.000 

1.000 

1.500 

1.500 

1.500 

2.000 

2.000 

2.000 

2.000 

2.000 

2.000 


1.000 
1.000 
1 .000 
1 .000 
1 .000 
1.000 
1.000 
1.000 
2.000 
2.000 
2.000 
2.000 
2.000 
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jo  code 

2.0C0 

data  flow  diagrams 

2.000 

red  lined  documentation 

2.000 

attend  sup  walkthrough 

2.000 

system  ana  lysis 

2.000 

attend  req  review 

2.000 

STRs 

2.000 

support  test  plans 

2.000 

des i gn 

2.000 

prep  technical  rpts 

2.000 

reading  tech  pubs 

2.000 

reviewing  tech  work 

2.000 

teach i ng 

2.000 

updating  training  manual 

2.000 

being  trained 

2.000 

func  system  design 

2.000 

func  module  design 

2.000 

def  global  data  strucs 

2.000 

def  subsystem  interface 

2.000 

def  stuff  for  own  use 

2.000 

cod i ng 

2.000 

debugging  or  modifying 

2.000 

prep  sys  rqt  docs 

2.000 

prep  red  lined  docs 

2.000 

prep  version  descr  mnls 

2.000 

prep  user  manuals 

2.000 

documenting  code 

2.000 

defining  test  cases 

2.000 

prep  test  drivers 

2.000 

prep  test  plans 

2.000 

hardware  testing 

2.000 

system  software  test 

2.000 

defining  mod  test  cases 

2.000 

software  module  testing 

2.000 

documenting  test  results 

2.000 

prep  trouble  reports 

2.000 

analyzing  trouble  rpts 

2.000 

Cl  us 

contract  negotiation 

1.000 

sales  marketing 

1 .000 

prep  version  audits 

1.000 

ga  1 i brary  control 

1.000 

correspondence 

1.000 

development  other 

1.000 

other  admin  tasks 

1.000 

temp  ECPs 

1.000 

red  lined  documentation 

1 .000 

support  test  plans 

1.000 

support  test  drivers 

1.000 

jo  tech  advice  to  CC3 

1.000 

uodated  MIL  STD  spec 

1.000 
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formulating  policy  2.000 
formulating  strategy  2.000 
preparing  budgets  2.000 
sales  marketing  2.000 
ga  program  management  2.000 
pd  technical  management  2.000 
formulation  of  strategy  2.000 
formulation  of  policy  2.000 
correspondence  2.000 
maint  config  procs  2.000 
prep  version  audits  2.000 
ga  quality  assurance  2.000 
prep  temp  eng  change  rpt  2.000 
hard  soft  tradeoff  eval  2.000 


38 


data  flow  diagrams  1.000 
documenting  test  results  1.000 
j°  code  1.000 
prog  design  language  1.000 
requirements  specs  1.000 
design  specs  1.000 
test  plans  1.000 
integration  plans  1.000 
documenting  code  1.000 
status  reports  1.000 
debugging  or  modifying  1.000 
reading  tech  pubs  1.000 
def  stuff  for  own  use  1.000 
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jo  i  i  brary  control 

1.000 

maintain  config  procs 

1  .000 

updated  training  manuals 

1 .000 

STSs 

1  .000 

automated  buiio  systems 

1  .000 

management  Info  reports 

1.000 

version  descrip  docs 

1.000 

vers i on  aud i ts 

1  .coo 

fiela  engineering  report 

1.CC0 

support  other 

1 .000 

preparing  fid  eng  rpts 

1.000 

fO'-mulat'On  of  policy 

1.000 

formulation  of  strategy 

1 .000 

pd  program  management 

1 .000 

configuration  management 

1.000 

pd  quality  assurance 

i  .000 

monitoring  contracts 

1.000 

other  development 

1.000 

conduct  support  dr 

1.000 

sup  policy  formulation 

1.000 

conduct  sup  walkthrough 

1.000 

attend  sup  walkthrough 

1.000 

sup  technical  management 

1 .000 

sup  program  management 

1.000 

SCCB  participation 

1.000 

sup  config  management 

;.C00 

sup  quality  assurance 

1 .000 

sup  monitoring  contracts 

1  .000 

other  support 

1.000 

ga  program  management 

1.000 

management  plans 

1.500 

attend  support  dr 

2.  CC0 

cost  data 

2 .000 

formulating  policy 

2.000 

formulating  strategy 

2.000 

interviewing  personnel 

2.000 

conduct  req  review 

2.000 

STR  analyses 

2.000 

interview  sheets 

2.000 

analysis  reports 

2.000 

ga  quality  assurance 

2.000 

prep  temp  eng  change  rpt 

2.000 

C  1  U! 

cost  data 

1 .000 

mi  1 estone  charts 

1.000 

analysis  reports 

1.000 

hard  soft  tradeoff  eval 

1 . 000 

conduct  req  review 

1.000 

pd  technical  management 

1.500 

reaui  retrents  specs 

2.000 

interview  sneets 

2.000 
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def  subsystem  interface 

1  .000 

cef  giobai  cats  szrjcs 

1.000 

<unc  module  oesign 

1  .000 

func  system  ces i gn 

1.000 

teach i ng 

!  .000 

reviewing  tecr  *,ork 

1 .000 

s v s t st  ana'ysis 

1  .000 

coding 

1 .000 

analyzing  trouble  rpts 

1.C00 

Drep  sys  rat  aocs 

1.000 

prep  test  drivers 

1.000 

software  module  testing 

1  .000 

defining  mod  test  cases 

1 .000 

system  software  test 

1 .000 

prep  test  plans 

1 .000 

defining  test  cases 

1  .000 

prep  user  manuals 

1.500 

aes i gn 

1.500 

prep  technical  rpts 

1 .500 

prep  red  1  i ned  docs 

1.500 

updating  training  manual 

2.000 

ga  technical  management 

2.000 

attend  design  review 

2.000 

mi  lestone  charts 

2.000 

hardware  testing 

2 .000 

2* is no  req  review 

2 . 000 

conduct  design  review 

2.000 

prep  version  descr  mnls 

2.000 

pd  code 

2.000 

conduct  walkthroughs 

2.000 

being  trained 

2.000 

test  drivers 

2.000 

prep  trouble  reports 

2.000 

preparing  schedules 

2.000 

r  57 


prep  version  descr  mnls  1,000 
prep  trouble  reports  1,000 
preparing  budgets  1.000 
prep  temp  eng  change  rpt  1,000 
ga  quality  assurance  1.000 
being  trained  1.000 
updating  training  manual  1.000 
ma:nt  config  procs  1.000 
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correspondence 

2.000 

prep  technical  rpts 

1.500 

development  other 

2.000 

prep  user  manuals 

1.500 

temp  ECPs 

2.000 

prep  redl i ned  docs 

1.500 

support  test  drivers 

2.000 

STR  analyses 

2.000 

jo  tech  advice  to  CC8 

2.000 

interviewing  personnel 

2.000 

updated  MIL  STD  spec 

2.000 

func  module  design 

2.000 

jo  1 i brary  control 

2.000 

ga  1  ibrary  control 

2.000 

maintain  config  procs 

2.000 

ga  tech  advice  to  CCB 

2.000 

updated  training  manuals 

2.000 

other  admin  tasks 

2.000 

updated  user  manuals 

2.000 

preparing  mgmt  info  rpts 

2.000 

automated  build  systems 

2.000 

reading  tech  pubs 

2.000 

management  info  reports 

2.000 

def  global  data  strucs 

2.000 

version  descrip  docs 

2.000 

def  subsystem  interface 

2.000 

vers i on  aud i ts 

2.000 

def  stuff  for  own  use 

2.000 

field  engineering  report 

2.000 

debugging  or  modifying 

2.000 

test  drivers 

2.000 

prep  sys  rqt  docs 

2.000 

integration  plans 

2.000 

func  system  design 

2.000 

conduct  design  review 

2.000 

teach i ng 

2.000 

conduct  walkthroughs 

2.000 

reviewing  tech  work 

2.000 

formulation  of  policy 

2.000 

documenting  code 

2.000 

support  other 

2.000 

defin’-g  test  cases 

2.000 

do  program  management 

2.000 

prep  test  plans 

2.000 

configuration  management 

2.000 

system  software  test 

2.000 

pd  quality  assurance 

2.000 

defining  mod  test  cases 

2.000 

monitoring  contracts 

2.000 

documenting  test  results 

2.000 

other  development 

2.000 

attend  walkthroughs 

2.000 

support  analysis 

2.000 

analyzing  trouble  rpts 

2.000 

support  design 

2.000 

conduct  support  dr 

2.000 

conduct  sup  walkthrough 

2.000 

sup  technical  management 

2.000 

sup  policy  formulation 

2.000 

sup  program  management 

2.000 

SCCB  participation 

2.000 

sup  config  management 

2.000 

sup  quality  assurance 

2.000 

sup  monitoring  contracts 

2.000 

other  support 

2.000 

sales  marketing 

2.000 

preparing  fid  eng  rpts 

2.000 

prep  version  audits 

2.000 

These  results  suggest  at  least  two  fundamental  distinctions — 
management/nonmanagement  and  development/support/admi n i s trat ion.  The  inter¬ 
pretation  of  these  results  indicates  that  cluster  2  is  administrative 
managers,  cluster  3  is  developmental ly  oriented  nonmanagement,  cluster  5  is 
support-oriented  nonmanagement,  cluster  38  is  support-oriented  management,  and 
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cluster  57  is  technical  management .  There  is  some  overlap  between  clusters  in 
terms  of  management  or  aam i n i s trat i ve  functions;  in  particular,  deve 1 opmenta i 
nonmanagers  seem  to  rate  moderately  highly  on  certain  management  functions. 
Part  of  that  sort  of  job  probably  involves  project  management  activities.  The 
number  of  individuals  assigned  to  each  of  the  clusters  supports  this 
characterization;  clusters  3  and  5  contain  a  little  over  three-quarters  of  the 
sample. 

The  particular  criteria  for  assigning  individuals  to  jobs  may  be  derived 
by  applying  the  first  ranked  values,  positive  and  negative,  to  a  given 
individual's  job  description.  It  is  not  clear  that  such  job  descriptions 
should  be  rigorously  limited  to  the  disjoint  categories  defined  by  the  ranked 
values.  It  would  be  more  appropriate  to  develop  a  match  point  score  based  on 
the  job  description  that  would  score  the  pattern  of  the  job  against  the  cate¬ 
gories.  Thus  a  given  job  description  might  share  attributes  of  several  cate¬ 
gories  (for  example,  a  technical  manager  who  formulates  policy  and  interviews 
personnel.  But  it  would  be  classified  as  technical  manager. 

One  of  the  implications  of  the  optimality  judgment  on  the  number  of 
clusters  is  that  there  are  no  viable  subclusters  distinguishable  in  the  data. 
That  is,  the  five  categories  developed  here  cannot  be  subdivided  further  due 
to  the  level  of  variation  among  the  respondents.  This  might  have  to  do  with 
the  nature  of  the  sampling  techni que--respondents  may  not  successfully  repre¬ 
sent  the  real  distribution  of  job  outputs,  principal  duties,  and  general 
activities.  A  better  explanation  is  that  the  categories,  particularly  those 
of  job  output  and  principal  duties,  represent  rather  noisy  duplication;  that 
is,  the  large  number  of  different  responses  contain  redundancies  that  serve  to 
obscure  the  mc-e  important  responses.  Removing  certain  of  the  responses  might 
produce  better  clusters,  but  the  process  would  be  very  involved.  Two 
:r;o4-2  0-50 
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Characterization  of  clusters.  —  In  the  rest  of  this  section,  some 
characterizations  of  the  sample  in  its  clusters  will  be  presented.  In  partic¬ 
ular,  characterizations  of  involvement  with  Ada,  professional  characteristics, 
years  of  involvement,  years  worked  in  support  and  development,  language  knowl¬ 
edge,  and  methodology  knowledge  will  be  presented. 

With  respect  to  involvement  with  Ada,  the  following  table  crosstabulates 
the  clusters  with  the  various  types  of  involvement.  This  table  has  no  valid 
chi  square  statistic  due  to  low  cell  expectations. 

Ada  involvement 

had  orientation  to  Ada 
heard  of  Ada  other 

Ada  not  known  Ada  training 


cluster2 

0 

23  15 

5 

3 

c 1 uster3 

4 

91  34 

24 

14 

cluster5 

8 

79  28 

12 

8 

c 1 uster38 

0 

3  9 

1 

1 

cluster57 

0 

12  8 

3 

7 

A1 though 

no 

conf i dence 

may 

be  put 

that  most  of 

the 

people  who 

know  Ada  a 

port  workers. 

The  distribution 

among 

some  trend  toward 

1  the  technical 

people 

The  following  table  presents  the  < 

conference  attendance 

yes 

no 

cluster2 

29 

16 

cluster3 

61 

105 

cluster5 

40 

94 

c 1 uster38 

11 

3 

c 1 uster57 

14 

16 
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This  table  indicates  that  managers  tend  to  go  to  conferences  more  often  than 
nonmanagers,  but  that  nonmanagers  go  to  as  many  conferences. 

The  following  table  presents  a  crosstabulation  of  publishing  or  presenta 
tion  of  papers  versus  the  clusters, 
published  or  presented 


yes  no 


c 1 uster2 

18 

27 

45 

c Iuster3 

32 

131. 

166 

clusters 

22 

113 

135 

clusters 

6 

8 

14 

cluster57 

9 

21 

30 

87 

303 

390 

This  table  indicates  that  managers  tend  to  publish  more  often. 

The  following  table  presents  a  crosstabulation  of  technical  reading  ver¬ 
sus  the  clusters;  the  table  has  no  valid  chi  square  statistic  due  to  low  cell 
expectat i ons . 

technical  reading  extent 


only  as  my  job  demands 
occasional ly 

regularly  never  other 


c!uster2 

23 

16 

1 

0 

0 

45 

cluster3 

68 

73 

13 

5 

1 

165 

c 1 uster5 

51 

60 

16 

7 

1 

135 

cluster38 

7 

6 

1 

0 

0 

14 

clusterp7 

17 

12 

0 

0 

0 

29 

171 

172 

31 

12 

2 

388 

This  table  indicates  that  no  manager  will  admit  to  not  doing  any  technical 
reading  but  that  some  workers  do.  Management  tends  to  read  more  regularly  as 
well. 

The  following  table  presents  a  crosstabulation  of  technical  society  mem¬ 
bership  versus  cluster;  the  chi  square  statistic  is  significant  at  the  95  per 
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technical  societies 


yes  no 


cluster2 

19 

25 

kk 

cl uster3 

55 

110 

165 

c 1 uster5 

35 

99 

13k 

cluster38 

6 

8 

lk 

cluster57 

15 

H 

29 

130 

256 

386 

According  to  this  table,  there  isn't  much  difference  between  clusters  in  mem¬ 
bership  in  technical  societies.  Support  oriented  workers  might  tend  to  belong 
a  bit  less  than  other  employees. 

The  following  table  presents  a  crosstabulation  of  years  of  involvement 
versus  cluster.  This  table  has  no  valid  ch!  square  statistic  due  to  small 
cell  expectations. 

years  of  involvement 


five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 


cluster2 

0 

2 

6 

38 

k6 

cluster3 

13 

k7 

3k 

73 

167 

cluster5 

2k 

k6 

2k 

39 

133 

cluster 38 

2 

0 

2 

10 

lk 

cluster57 

0 

1 

3 

26 

30 

39 

96 

69 

186 

390 

Although  not  conclusive,  this  table  indicates  that  managers  tend  to  be  experi¬ 
enced  people  while  nonmanagers  are  less  so;  still,  most  people  tend  to  be  very 
experienced. 

The  following  tables  crosstabul ate  years  worked  in  development  and  sup¬ 
port;  the  support  table  has  no  valid  chi  square  statistic  due  to  small  cell 
expectat i ons . 


vm-? 
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years  worked  development 

three  to  five  years 
one  to  three  years 
less  than  a  year  over  five  years 


c luster2 

2 

3 

5 

35 

45 

cluster3 

26 

35 

37 

62 

160 

clusters 

36 

35 

17 

33 

12! 

cluster38 

4 

0 

0 

10 

14 

cluster57 

3 

1 

3 

21 

28 

71 

7k 

62 

161 

368 

years  worked  support 

three 

to  five 

years 

one  to 

three 

years 

1  ess 

than  a 

year 

over 

five  years 

cluster2 

7 

3 

2 

14 

26 

c!uster3 

31 

32 

26 

35 

124 

c luster5 

44 

26 

8 

12 

90 

cl uster38 

2 

2 

0 

6 

10 

cluster57 

4 

4 

5 

6 

19 

88 

67 

41 

73 

269 

Respondents  seem  fairly  well  distributed  aside  from  a  large  lump  from  cluster 
5  being  inexperienced  in  support.  The  interrelationships  between  these 
attributes  mentioned  in  the  section  on  single  variables  (that  is,  the  various 
combinations  of  support  and  development  experience)  probably  obscure  any  in¬ 
teresting  trends  here.  Again,  the  largest  fact  is  that  most  people,  whether 
in  support  or  development,  have  more  or  less  extensive  development  experience 
and  relatively  little  support  experience.  This  fact  is  due  mainly  to  an  ap¬ 
parent  industry  concentration  on  development  at  the  expense  of  support. 

The  following  table  lists  the  programming  languages  known  versus  the 
clusters;  it  has  no  significant  chi  square  statistic  due  to  zero  marginals. 
The  table  following  integrates  the  lesser-known  languages;  that  table  has  a 
chi  square  value  significant  only  at  the  20  percent  level. 
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language 


admi ni strat i ve_manager 
deve I opment_nonmanager 
suppor  t_nonmanager 
suppor  t_manager 
techn i ca l_manager 


admi ni strat i ve_manager 
deve I opment_nonmanager 
suppor  t_nonmanager 
suppor t_manager 
techn i cal ^manager 


admi ni strat ive_manager 
deve I ooment_nenmanager 
suppor  t_nonmanager 
suppor  t_manager 
techn i ca l_manager 


admi ni strat i ve_manager 
deve I opment_nonmanager 
suppor  t_nonmanager 
suppor  t_manager 
techni ca l_manager 


ASSEMBLER 

JOVIAL 

CMS_2 

C 

FORTRAN  COBOL 

PLI 

17 

17 

5 

46 

21 

44 

23 

30 

53 

16 

155 

89 

154 

77 

21 

38 

8 

124 

59 

112 

67 

5 

8 

0 

13 

5 

12 

6 

8 

13 

4 

28 

15 

28 

14 

81 

129 

33 

366 

189 

350 

187 

RATFOR 

WATFOR. 

.WATF 1 V 

PASCAL 

BASIC 

ALGOL- 

M0DULA 

SIMULA 

XPL 

22 

31 

15 

9 

0 

1 

2 

85 

105 

36 

43 

3 

4 

5 

62 

83 

23 

31 

2 

2 

2 

3 

9 

3 

2 

0 

0 

0 

19 

24 

9 

5 

1 

2 

] 

191 

252 

86 

90 

6 

9 

10 

MMP 

FORTH 

Ada 

LISP 

SN0B0L 

ECL  GPSS 

0 

2 

14 

7 

7 

1 

12 

0 

9 

41 

32 

31 

1 

19 

0 

11 

29 

18 

23 

1 

18 

0 

0 

4 

1 

2 

0 

1 

0 

6 

13 

5 

8 

0 

5 

0 

28 

101 

63 

71 

3 

55 

SAS 

PROTEGE 

PPL 

apl 

Other 

2 

0 

0 

12 

4 

314 

1 

0 

0 

42 

43 

1074 

4 

1 

0 

38 

26 

803 

0 

0 

0 

1 

5 

80 

0 

0 

0 

9 

12 

229 

7 

1 

0 

102 

90 

2500 

language 

ASSEMBLER 


JOVIAL 

CMS_2 

FORTRAN 

COBOL 

PLI 

PASCAL 

adm i n i s  t  r  a  t i ve_manager 

17 

17 

46 

21 

44 

23 

22 

deve lopment_nonmanager 

30 

53 

155 

89 

154 

77 

85 

suppor  t_nonmanager 

21 

38 

124 

59 

112 

67 

O 

suppor  t_manager 

5 

8 

13 

5 

12 

A 

* 

techn i ca  ^manager 

8 

13 

28 

15 

28 

14 

J 

19 

81 

129 

366 

189 

350 

187 

191 

;o  9/t-? 
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BASIC 

Other 

admi n i s trat i ve_manager 

31 

93 

314 

deve ! opment_nonmanager 

105 

326 

1074 

suppor  t_nonmanager 

83 

237 

803 

supoort_manager 

9 

19 

80 

techn i ca l_manager 

24 

80 

229 

252 

755 

2500 

This  table  indicates,  perhaps,  a  tendency  for  management  to  know  more 
about  programming  languages  than  workers,  but  the  rankings  are  about  the  same 
for  all  clusters.  The  tendency  of  managers  to  pe  more  experienced  than  work¬ 
ers  may  explain  this  greater  knowledge. 

Since  there  are  a  large  number  of  methodologies,  a  straightforward  pre¬ 
sentation  of  counts  would  not  be  very  informative.  Instead,  the  median  pol¬ 
ish  and  ranking  of  residuals  is  repeated  for  methodologies  to  see  how  the  var 
ious  clusters  are  unusual  both  positively  and  negatively. 

Median  Polish  of  Methodologies  against  Five  Clusters 
Effects  and  Typicals  after  Polishing 


effects 

common 

33.250 

cluster2 

0.000 

ctuster3 

71.500 

clusters 

31 .000 

cluster38 

-24-500 

cluster57 

-14.500 

PSL  PLA 

-10.250 

SADT 

-15.250 

SREM 

-21.250 

HIP0 

9.750 

Jackson  Design 

-15.250 

Structured  Design 

11.750 

Warnier  Orr  Design 

-14.250 

N  S  Chaoin  Chart 

-12.250 

Beamson  Tables 

-29.250 

Program  Design  language 

8.250 

Structured  Programming 

12.750 

Structured  Walkthroughs 

10.750 

~co  Dewn  Design 

12.750 

t~  dn  lit  i'iMfifcii  i  iX, 


IC94-2 
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Top  Down  Testing 

11.750 

Bottom  Up  Design 

11.750 

Bachman  Diagramming 

-29.250 

Ent i ty  D i agrams 

-30.250 

Data  Abstraction 

-11.250 

other  methodology 

-30.250 

enumeration  types 

-3.250 

floating  point  types 

12.750 

fixed  point  types 

11.750 

user  defined  types 

8.25C 

poi nters 

11.750 

typed  pointers 

5.750 

records 

10.750 

ranges 

11.750 

variant  records 

3.250 

object  type  dels 

6.250 

global  variables 

11.750 

local  variables 

11.750 

formal  actual  params 

10.750 

reserved  words 

11.750 

blocks 

10.750 

case  statements 

10.250 

if  then  else  statements 

12.750 

loop  for  while  unti 1 

12.750 

exit  statements 

12.750 

orocedures 

12.750 

f unct i ons 

12.750 

return  statements 

12.750 

clusters  modules  package 

9.750 

stubs 

8.750 

goto  statements 

11.250 

comments 

12.750 

exception  handlers 

7.750 

task  coroutines 

8.250 

other  prog  constructs 

-33.250 

importing  exporting  name 

-15.250 

data  encapsulation 

3.250 

name  scoping 

-9.250 

name  vi s i bi 1 i ty 

-10.250 

static  dynamic  nesting 

1.750 

i teration 

10.250 

conditional  statements 

10.750 

recurs i on 

10.750 

concurrency 

4.250 

strong  typing 

0.250 

type  conversion 

8.750 

data  abstraction 

3.250 

gener i cs 

-7.250 

loop  invariants 

-3.250 

parameter  binding 

-1.750 

version  number 

4.750 

other  p-og  concepts 

-33.250 

Ada  ^numeration  types 

-8.250 

1094-2  D-57 
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Ada 

user  defined  types 

-0.250 

Ada 

suDtvses 

-7.250 

Ada 

derived  types 

-10.250 

Ada 

real  types 

0.750 

Ada 

float  point  types 

2.750 

Ada 

fixed  pt  types 

1-750 

Ada 

record  types 

0.250 

Ada 

rec  types  d 1  sc r  im 

-15-250 

Ada 

s I i ces 

-21.250 

Ada 

aggregates 

-20.250 

Ada 

a i locators 

-20.250 

Ada 

access  types 

-13.250 

Ada 

over  1  oad  i  ng 

-18.250 

Ada 

packages 

-11.250 

Ada 

private  types 

-16-250 

Ada 

scope 

-10.250 

Ada 

shor  t  c i r  cu i t i ng 

-19-250 

Ada 

v  i  s i b i 1 i ty 

-17.250 

Ada 

task i ng 

-A. 750 

Ada 

task  types 

-9.250 

Ada 

rendezvous 

-15.250 

Ada 

entr ies 

-7-250 

Ada 

entry  f ami  1 i es 

-16. 250 

Ada 

separate  compilation 

-2.750 

Ada 

except i ons 

-9.250 

Ac  3 

*  0  P  t  C  tjf>  ‘  t S 

-1?.2C0 

Ada 

i nstant i at i on 

-18-250 

Ada 

elaboration 

-18. 250 

Ada 

context  spec 

-U.250 

Ada 

information  hiding 

-12.250 

Ada 

mutual  recursion 

-18. 250 

other  Ada  concepts 

-33.250 

Residuals  after  Polishing 


Warnier  Orr  Design 


Jackson  Design 

N  S  Chapin 

PSl  PLA 

SAOT 

SREtt 

HIP0 

Structured  Design 

cluster2 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000  0.000 

cluster3 

-37.500 

-59.500 

-66.500 

7-500 

-A9-500 

A2.500 

-51.500  -50.500 

clusters 

-8.000 

-29-000 

-28.000 

2.000 

-33-000 

A3 .000 

-2A-000  -33-000 

cluster38 

5.500 

13.500 

15.500 

-6-500 

12.500 

-7.500 

1A.500  7-500 

c  Iuster57 

3.500 

A. 5  00 

9-500 

-0.500 

5.500 

-2.500 

6.500  3.500 

12?'-- 
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Structured  Programm i na  Top  Down  Testing 
Program  Design  language  Top  Down  Design  Bachman  Diagramming 

Beamson  Tables  Structured  Walkthroughs  Bottom  Up  Design 


c 1 uster2 

0.000 

-0.500 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

cluster3 

69-500 

35-000 

1*8-500 

1*1 .500 

1*7.500 

1*4.500 

33.500 

-54.500 

cluster5 

33-000 

39-500 

56-000 

36-000 

53-000 

42.000 

28-000 

-24.000 

c 1 uster38 

21.500 

-6.000 

-7.500 

-7.500 

-7.500 

-6.500 

-6-500 

22.500 

c 1 uster57 

12.500 

0.000 

- 1 . 500 

-0.500 

-1.500 

-1.500 

-1.500 

13.500 

other 

methodo 1 ogy 

f  i  xed 

po  i  nt 

types 

Data 

Abstract 

:  on 

float! 

ng  point 

types 

po i nters 

Ent  i 

ty  Diagrams 

enumerat i on 

types 

user 

def i ned 

types 

c 1 uster2 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

-0.500 

0.000 

cluster3 

•5A-500 

-4-500  - 

67-500 

-8.500 

1*5.500 

42.500 

32.000 

40.500 

clusters 

■21*. 000 

-8.000  - 

32.000 

9.000 

1*9.000 

48.000 

32.500 

47-000 

cluster38 

21,-500 

1 1 .500 

21.500 

1 .500 

-7.500 

-6-500 

-7.000 

-8-500 

c luster57 

18-500 

8.500 

13.500 

-1.500 

-1.500 

-1.500 

0.000 

-3.500 

g  lot 

u i  var i an 

1 1  es 

records 

object  type 

dc  1  s 

forma  1 

actua 1 

params 

typed  pointers  variant  -“cords 

local  variables  reserved  words 

c 1 uster2 

0.000 

0.000 

-1.500 

-0.500 

0.000 

0.000 

0.000 

0.000 

cluster3 

11 .500 

1*6-500 

10.000 

30.000 

1*9-500 

49.500 

27.500 

46-500 

c 1 uster5 

19.000 

1,7-000 

15.500 

37.500 

55.000 

55-000 

34.000 

42.000 

c 1  us  ter  38 

-6-500 

-7.500 

-5.000 

-6.000 

-7.500 

-7.500 

-9.500 

-8.500 

cluster57 

-0.500 

-0.500 

0.000 

0.000 

-1.500 

-2.500 

-4-500 

-3.500 

loop  for  while 

unti  1 

case  statements 

exit  statements 

f unct i ons 

blocks 

i  f  then 

else  statements 

procedures  return  statements 

cluster2 

0.000 

-0.500 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

c 1 uster3 

37-500 

1*5-000 

1,8.500 

1,7.500 

1*1* -500 

46-500 

48-500 

46-500 

cluster5 

1*1.000 

1,6.500 

51*.  000 

53.000 

1,9-000 

50.000 

50.000 

54.000 

cluster38  ■ 

-10.500 

-7.000 

-8.500 

-8.500 

-8.500 

-8.500 

-7.500 

-7.500 

cluster57 

-4-500 

0.000 

-1.500 

-2.500 

-1.500 

-2.500 

-2.500 

-1.500 

importing  exporting  name 

goto  statements 

other 

prog  constructs 

stubs 

exception  handlers 

c 1 usters 

modules 

package 

comments 

task  coroutines 

cluster2 

0.000 

0.000 

-1.500 

0.000 

0.000 

-1.500 

0.000 

0.000 

cluster3 

30.500 

31.500 

1*8.000 

1*6.500 

35.500 

35-000 

-69-500 

-35.500 

c 1 usterS 

33-000 

22.000 

53.500 

53-000 

26-000 

14.500 

-29.000 

-10.000 

c  1  uster38 

-l*-500 

-5.500 

-7.000 

-8.500 

-i*.500 

-7.000 

24.500 

11.500 

c 1 uster57 

-1.500 

-0.500 

0.000 

-1.500 

-0.500 

0.000 

16- 500 

8.500 

iO°A-2 
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name  visibility  conditional  statements 
name  scoping  iteration  concurrency 

data  encapsulation  static  dynamic  nesting  recursion 


c 1  us  ter  2 

-1.500 

o.ooc 

0.000 

0.000 

-0.500 

0.000  0.000  -1.500 

c 1 uster3 

G.000 

-7.500  - 

10.500 

6.500 

53-000 

56-500  36-500  25.000 

c i us  ter5 

2.500 

-A. 000  - 

1C. 000 

12.000 

38-500 

57-000  35-000  15.500 

c 1 uster38 

-3.000 

8.500 

7.500 

-1.500 

-5.000 

-6.500  -6.500  0.000 

c ! uster57 

0.000 

5.500 

7.500 

-0.500 

0.000 

-0.500  -1.500  0.000 

other  prog  concepts 

type  conversion 

gener i cs 

parameter  binding 

strong  typing  data 

abstraction  loop  invariants  version  number 

cluster2 

1.500 

0.000 

-2.500 

0.000 

0.000 

2.500  O.OOC  0.000 

c  i  uster3 

-7.000 

15.500 

10.000 

-8-500 

-6-500  ■ 

-11.000  19.500  -68-500 

c 1 uster5 

-2.500 

13.000 

0.500 

-I4.COO 

-3.000 

-5.50C  12.000  -30.000 

c 1  us  ter  38 

0.000 

-7.500 

-2.000 

8.500 

3.500 

0.000  -1.500  25.500 

c 1 uster57 

2.000 

-3.500 

0.000 

7.500 

1.500 

2.000  -0.500  15.500 

Ada 

subtypes 

Ada  fli 

sat  point  types 

Ada  user  defined 

types 

Ada 

real  types  Ada  record  types 

Ada  enumeration 

types 

Ada 

aer i ved 

types 

Ada  fixed  pt  types 

c  luster2 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000  0.000  -5.500 

cluste-3 

-15-500 

0.500  - 

10.500 

-13.500 

7.500 

11. 500  1C.5C0  3-000 

c  1  uster5 

-8.000 

-1.C00  - 

12.000 

- 1 4 .000 

3.000 

6.000  5.000  1.500 

c!uster38 

5.500 

2.500 

6.500 

7.500 

-1.500 

-0.500  -0.500  0.000 

c 1 uster57 

14.500 

-0.500 

5.500 

3.500 

-0  5co 

-1.500  -0.500  0.000 

Ada 

aggregates 

Ada  private  types 

Ada  s 1 i ces 

Ada 

access  types  Ada  packages 

Ada  rec  types 

di scr  im 

Ada  al locators  Ada 

over  1 oad i ng 

c)uster2 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000  0.000  0.000 

cluster3 

-19.500 

-28-500  - 

■31.500 

-30.500 

-23.50c 

-22.500  -15.500  -17.500 

c 1 uster5 

-1 1 .000 

-20.000  - 

■10.000 

-12.000 

-16.000 

-12.000  -10.000  -10.000 

c  1  uster38 

11. 500 

17.500 

16-500 

15.500 

10.500 

15.500  11.500  13.500 

c 1 uster57 

9.500 

12.500 

10.500 

12.500 

7.500 

10.500  7-500  13.500 

Ada  entry  f am i 1 i es 

Ada  short  circuiting  1 

Ada  tasking  Ada 

rendezvous 

Ada  scope  Ada 

visibility  Ada 

task  types  Ada  entries 

cluster2 

0.000 

0.000 

0.000 

-0.500 

0.000 

0.000  0.000  0.000 

ciuster3 

-18. 500 

-41. 500  ■ 

•13.500 

0.000 

-17.500 

-31.500  -25.500  -57.500 

c 1 usterj 

-10.000 

-25.000 

-7.000 

-2.500 

-10.000 

-16-000  -18-000  -25.000 

c 1 uster38 

8.500 

U.500 

13.500 

7.000 

8.500 

15.500  7.500  13.500 

cluster57 

7.500 

7.50c 

ic. 500 

3.000 

2.500 

9.500  2.500  8.500 
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Ada  generic  prog  units  Ada  context  spec 
Ada  exceptions  Ada  elaboration  Ada  mutual  recursion 


Ada  separate  comp 

1  i  at  i  on 

Aaa 

i ns  tant i at i on 

Ada  information 

hiding 

cluster2 

-0.500 

0.000 

0.000 

0.000  0.000 

0.000 

0.000 

0.000 

c 1 uster3 

3.000  - 

12-500 

-20.500 

-38-500  -43.500 

-36-500 

-18- 500 

-32.500 

c 1 uster5 

-2.500 

-5.0C0 

-9.000 

-15.000  -27.000 

-27.000 

-11 .000 

-20.000 

c 1 uster  38 

5.000 

8.500 

17.500 

16. 500  13.500 

9.500 

12.500 

14.500 

c l uster57 

0.000 

3.500 

ranges 

13.500 

9.500  7.500 

3.500 

6.500 

10.500 

other  Ada  concepts 

c!uster2  0.000  0.000 

cluster3  -71.500  25-500 

clustery  -30.000  33-000 

c  I  uster  38  21*. 500  -10.500 

cluster57  14.500  -5.5OO 


Categories  with  High  Positive 

Categories  with  High  Negat 

i  ve 

Residuals  in  Rank  Order 

Resi-Jois  in  Rank  Order 

Cl 

luster  2 

parameter  binding  1.000 

data  abstraction 

1.000 

strong  typing  2.000 

concurrency 

1.000 

Ada  record  types 

1 .000 

Program  Design  language 

2.000 

goto  statements 

2.000 

user  defined  types 

2.000 

task  coroutines 

2.000 

data  encapsulation 

2.000 

i teration 

2.000 

case  statements 

2.000 

object  type  dels 

2.000 

variant  records 

2.000 

Ada  tasking 

2.000 

Ada  separate  compilation 

2.000 

Cluster  3 

HIPC 

1.000 

PSL  PLA 

1.000 

stubs 

1. 000 

SADT 

1 .000 

Ada  record  types 

1 .000 

SREM 

1.000 

Ada  fixed  pt  types 

1 .000 

Jackson  Design 

1.000 

Structured  Walkthroughs 

1.000 

Warni er  Orr  Des i gn 

1 .000 

Ada  float  point  types 

1.000 

N  S  Chapin  Chart 

1.000 

Top  Down  Testing 

1.000 

Beamson  Tables 

1.000 

Bottom  Up  Design 

1.000 

Bachman  Diagramming 

1.000 

Ada  real  types 

1.000 

Ent i ty  D i agrams 

1.000 

concurrency 

1.000 

Ada  entries 

1.000 

ve^s ' on  number 

1.000 

other  methodology 

1.000 

data  aostraction 

1.000 

enumeration  types 

1 .000 

MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS -1963- A 


Ada  Workforce  Survey 


Page  60. 


type  conversion 

1.000 

other  prog  constructs 

1.000 

recursion 

1.000 

importing  exporting  name 

1.000 

i teration 

1.000 

name  scoping 

1.000 

task  coroutines 

1.000 

name  visibility 

1.000 

reserved  words 

1.000 

strong  typing 

1.000 

exception  handlers 

1.000 

gener i cs 

1.000 

fixed  point  types 

2.000 

loop  invariants 

1.000 

object  type  dels 

2.000 

parameter  binding 

1.000 

local  variables 

2.000 

other  prog  concepts 

1.000 

case  statements 

2.000 

Ada  rec  types  discrim 

1.000 

if  then  else  statements 

2.000 

Ada  enumeration  types 

1.000 

Structured  Design 

2.000 

Ada  derived  types 

1.000 

exit  statements 

2.000 

Ada  si  ices 

1.000 

procedures 

2.000 

other  Ada  concepts 

1.000 

functions 

2.000 

Ada  aggregates 

1.000 

return  statements 

2.000 

Ada  al locators 

1.000 

clusters  modules  package 

2.000 

Ada  access  types 

1.000 

loop  for  while  until 

2.000 

Ada  overloading 

1.000 

goto  statements 

2.000 

Ada  packages 

1.000 

comments 

2.000 

Ada  private  types 

1.000 

blocks 

2.000 

Ada  scope 

1.000 

formal  actual  params 

2.000 

Ada  short  circuiting 

1.000 

static  dynamic  nesting 

2.000 

Ada  visibility 

1.000 

global  variables 

2.000 

Ada  task  types 

1.000 

conditional  statements 

2.000 

Ada  rendezvous 

1.000 

variant  records 

2.000 

Ada  entry  families 

1.000 

records 

2.000 

Ada  exceptions 

1.000 

typed  pointers 

2.000 

Ada  generic  prog  units 

1.000 

pointers 

2.000 

Ada  instantiation 

1.000 

user  defined  types 

2.000 

Ada  elaboration 

1.000 

Ada  user  defined  types 

2.000 

Ada  context  spec 

1.000 

floating  point  types 

2.000 

Ada  information  hiding 

1.000 

Top  Down  Design 

2.000 

Ada  mutual  recursion 

1.000 

Structured  Programming 

2.000 

Data  Abstraction 

2.000 

Program  Oesign  language 

2.000 

Ada  subtypes 

2.000 

Ada  separate  compilation 

2.000 

ranges 

2.000 

Cluster  5 


ranges 

1.000 

Ada  tasking 

1.000 

Structured  Design 

1.000 

Data  Abstraction 

1.000 

Program  Oesign  language 

1.000 

Ada  subtypes 

1.000 

Structured  Programming 

1.000 

Ada  user  defined  types 

1.000 

goto  statements 

1.000 

Ada  separate  compilation 

1.000 

Top  Down  Design 

1.000 

SADT 

2.000 

return  statements 

1.000 

Beamson  Tables 

2.000 

functions 

1.000 

Bachman  Diagramming 

2.000 

enumeration  types 

1.000 

N  S  Chapin  Chart 

2.000 

floating  point  types 

1.000 

Warnier  Orr  Design 

2.000 

fixed  point  types 

1.000 

other  methodology 

2.000 

user  defined  types 

1.000 

PSL  PIA 

2.000 

pointers 

1.000 

other  prog  constructs 

2.000 
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typed  pointers 

1.000 

name  scoping 

2.000 

records 

1.000 

strong  typing 

2.000 

variant  records 

1.000 

importing  exporting  name 

2.000 

object  type  dels 

1.000 

gener i cs 

2.000 

global  variables 

1.000 

loop  invariants 

2.000 

local  variables 

1.000 

parameter  binding 

2.000 

formal  actual  params 

1.000 

other  prog  concepts 

2.000 

static  dynamic  nesting 

1.000 

Ada  enumeration  types 

2.000 

blocks 

1.000 

Jackson  Design 

2.000 

case  statements 

1.000 

SREM 

2.000 

if  then  else  statements 

1.000 

Ada  derived  types 

2.000 

loop  for  while  unti 1 

1.000 

Ada  rec  types  di scrim 

2.000 

exit  statements 

1.000 

Ada  s 1  ices 

2.000 

procedures 

1.000 

Ada  aggregates 

2.000 

clusters  modules  package 

1.000 

Ada  al locators 

2.000 

comments 

1.000 

Ada  access  types 

2.000 

conditional  statements 

1.000 

Ada  overloading 

2.000 

data  encapsulation 

1.000 

Ada  packages 

2.000 

Bottom  Up  Design 

2.000 

Ada  private  types 

2.000 

Top  Down  Testing 

2.000 

Ada  scope 

2.000 

stubs 

2.000 

Ada  short  circuiting 

2.000 

Structured  Walkthroughs 

2.000 

Ada  visibility 

2.000 

reserved  words 

2.000 

name  visibility 

2.000 

exception  handlers 

2.000 

Ada  task  types 

2.000 

i teration 

2.000 

Ada  rendezvous 

2.000  ( 

recurs i on 

2.000 

Ada  entries 

2.000 

task  coroutines 

2.000 

Ada  entry  fami 1 i es 

2.000 

concurrency 

2.000 

Entity  Diagrams 

2.000 

type  conversion 

2.000 

Ada  exceptions 

2.000 

data  abstraction 

2.000 

Ada  generic  prog  units 

2.000 

version  number 

2.000 

Ada  instantiation 

2.000 

Ada  real  types 

2.000 

Ada  elaboration 

2.000 

Ada  float  point  types 

2.000 

Ada  context  spec 

2.000 

Ada  fixed  pt  types 

2.000 

Ada  information  hiding 

2.000 

Ada  record  types 

2.000 

Ada  mutual  recursion 

2.000 

HIPO 

2.000 

other  Ada  concepts 

2.000 

Cluster  38 

PSL  PLA 

1.000 

HIPO 

1.000 

SADT 

1.000 

Structured  Design 

1.000 

SRErt 

1.000 

Program  Design  language 

1.000 

Jackson  Design 

1.000 

Structured  Programming 

1.000 

Warnier  Orr  Design 

1.000 

Structured  Walkthroughs 

1.000 

N  S  Chapin  Chart 

1.000 

Top  Down  Design 

1.000 

Beamson  Tables 

1.000 

Top  Down  Testing 

1.000 

Bachman  Diagramming 

1.000 

Bottom  Up  Design 

1.000 

Entity  Diagrams 

1.000 

floating  point  types 

1.000 

Oata  Abstraction 

1.000 

fixed  point  types 

1.000 

other  methodology 

1.000 

user  defined  types 

1.000 

Ada  rendezvous 

1.000 

pointers 

1.000 

other  prog  constructs 

1.000 

typed  pointers 

1.000 

importing  exporting  name 

1.000 

records 

1.000 

1094-2 

D-63 

Ada  Workforce  Survey 


P»9*  62 


name  scoping 

1.000 

Ada  short  circuiting 

1.000 

generics 

1.000 

loop  invariants 

1.000 

other  prog  concepts 

1.000 

Ada  enumeration  types 

1 .000 

Ada  user  defined  types 

1.000 

Ada  subtypes 

1.000 

Ada  derived  types 

1.000 

Ada  rec  types  di scrim 

1.000 

Ada  s 1 i ces 

1.000 

Ada  aggregates 

1.000 

Ada  allocators 

1.000 

Ada  access  types 

1.000 

Ada  overloading 

1.000 

Ada  packages 

1.000 

Ada  instantiation 

1.000 

Ada  scope 

1.000 

Ada  exceptions 

1.000 

Ada  visibility 

1.000 

Ada  tasking 

1.000 

Ada  task  types 

1.000 

Ada  entries 

1.000 

Ada  entry  families 

1.000 

Ada  separate  compilation 

1.000 

Ads  gene-ic  prec  units 

1.000 

Ada  elaboration 

1.000 

Ada  context  spec 

1.000 

Ada  information  hiding 

1.000 

Ada  mutual  recursion 

1.000 

other  Ada  concepts 

1.000 

name  visibility 

1.500 

Ada  private  types 

1.500 

enumeration  types 

2.000 

Cl 


strong  typing 

1.000 

Ada  private  types 

1.500 

name  visibility 

1.500 

9SL  PLA 

2.000 

*-.''<<on  Oesign 

2.000 

N  S  Chapin  Cnart 

2.000 

deamson  Tables 

2.000 

SREM 

2.000 

SAOT 

2.000 

Data  Abstraction 

2.000 

other  methodology 

2.000 

other  prog  constructs 

2.000 

importing  exporting  name 

2.000 

name  scoping 

2.000 

Enti ty  Diagrams 

2.000 

Bachman  Diagramming 

2.000 

109&-2 


variant  records 

1.000 

object  type  dels 

1.000 

global  variables 

1.000 

local  variables 

1.000 

formal  actual  params 

1.000 

reserved  words 

1.000 

blocks 

1 .000 

case  statements 

1.000 

• r"  ihen  else  statements 

1.000 

loop  for  while  unti 1 

1.000 

exit  statements 

1.000 

procedures 

1.000 

function? 

1.000 

return  statements 

1.000 

clusters  modules  package 

1.000 

stubs 

1.000 

goto  statements 

1.000 

comments 

1.000 

exception  handlers 

1.000 

task  coroutines 

1.000 

data  encapsulation 

1.000 

static  dynamic  nesting 

1.000 

iteration 

1.000 

conditional  statements 

1.000 

recursion 

1.000 

type  conversion 

1.000 

version  number 

1.000 

Ada  real  types 

1.000 

ranges 

1.000 

Ada  fixed  pt  types 

1.500 

data  abstraction 

2.000 

Ada  float  point  types 

2.000 

utter  57 


Ada  float  point  types 

1.000 

Ada  fixed  pt  types 

1.500 

HIP0 

2.000 

Structured  Walkthroughs 

2.000 

Top  Down  Design 

2.000 

Top  Down  Testing 

2.000 

Bottom  Up  Design 

2.000 

enumeration  types 

2.000 

floating  point  types 

2.000 

fixed  point  types 

2.000 

pointers 

2.000 

typed  pointers 

2.000 

records 

2.000 

global  variables 

2.000 

local  variables 

2.000 

formal  actual  params 

2.000 
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generics 

2.000 

reserved  words 

2.000 

loop  invariants 

2.000 

blocks 

2.000 

Warnier  Orr  Design 

2.000 

if  then  else  statements 

2.000 

other  prog  concepts 

2.000 

loop  for  while  unti  1 

2.000 

Ada  enumeration  types 

2.000 

exit  statements 

2.000 

Ada  subtypes 

2.000 

procedures 

2.000 

Ada  derived  types 

2.000 

functions 

2.000 

Ada  rec  types  di scrim 

2.000 

return  statements 

2.000 

Ada  si  ices 

2.000 

clusters  modules  package 

2.000 

Ada  aggregates 

2.000 

stubs 

2.000 

Ada  al locators 

2.000 

comments 

2.000 

Ada  access  types 

2.000 

exception  handlers 

2.000 

Ada  overloading 

2.000 

static  dynamic  nesting 

2.000 

Ada  packages 

2.000 

conditional  statements 

2.000 

parameter  binding 

2.000 

recurs  ion 

2.000 

Ada  scope 

2.000 

type  conversion 

2.000 

Ada  short  circuiting 

2.000 

version  number 

2.000 

Ada  visibility 

2.000 

Ada  user  defined  types 

2.000 

Ada  tasking 

2.000 

Ada  real  types 

2.000 

Ada  task  types 

2.000 

Structured  Programming 

2.000 

Ada  rendezvous 

2.000 

Structurca  Design 

2.000 

Ada  entries 

2.000 

ranges 

2.000 

Ada  entry  fami 1 ies 

2.000 

Ada  exceptions 

2.000 

Ada  generic  prog  units 

2.000 

Ada  instantiation 

2.000 

Ada  elaboration 

2.000 

Ada  context  spec 

2.000 

Ada  information  hiding 

2.000 

Ada  mutual  recursion 

2.000 

other  Ada  concepts 

2.000 

The  administrative  managers  (cluster  2)  aren't  very  strong  on  anything 
except  parameter  binding,  probably  a  random  outlier.  They  aren't  very  weak  on 
anything,  either,  but  with  some  tendency  against  technical  programming. 

The  developmental ly  oriented  nonmangers  (cluster  3)  rate  very  strongly  on 
design  methodologies,  some  Ada  concepts,  and  various  programming  constructs 
and  concepts.  They  are  weak  on  some  of  the  design  methodologies,  certain  pro- 
gramming  concepts,  and  most  Ada  concepts. 

The  support-oriented  nonmanagers  (cluster  5)  »re  strong  on  standard  de¬ 
sign  methodologies  and  standard  programming  constructs  snd  are  somewhat  less 
strong  on  various  programming  concepts.  They  are  weak  on  Ada  concepts  and 
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certain  programming  methodologies  and  constructs.  They  seem  to  have  the 
basics  but  are  not  theoretically  sophisticated. 

The  support-oriented  managers  are  strong  on  certain  design  methodologies, 
programming  concepts,  and  Ada  concepts.  They  are  weak  on  other  design 
methodologies  and  programming  constructs.  These  people  would  seem  to  be  some¬ 
what  eccentric.  Perhaps  these  are  the  type  of  people  who  tend  to  gravitate  to 
the  "less  practical" — that  is,  less  technical /developments  1— side  of  the  in¬ 
dustry. 

The  technical  managers  tend  to  be  relatively  strong  on  certain  program¬ 
ming  concepts,  many  design  methodologies,  and  several  Ada  concepts,  but  weak 
on  other  methodologies  and  on  programming  constructs. 

In  summary,  the  characterizations  of  the  clusters  support  the  classifica¬ 
tions  in  large  part.  There  are  few  startling  departures  from  common  sense. 

Current  titles. — a  table  showing  current  job  titles  and  positions  in  the 
management  hierarchy  for  the  clusters  indicates  the  relationship  between  the 
way  the  industry  currently  defines  jobs  and  the  classification  scheme 
developed  in  this  report. 

Respondent  Job  Title  Position  in  Hierarchy 

administrative  manager 

1003  Chief,  CAO/CAM  Systems  middle  mgmt 

1005  Staff  Specialist  technical 

1011  Projact  Engineer  technical 

!0 i 3  Software  Design  Specialist  technical 

1018  Engineering  Software  Supervisor  middle  mgmt 
1020  Software  Design  Specialist  technical 

1023  ' if tware  Engineering  Specialist  technical 

1025  Engineering  Specialist  technical 

1039  Engineering  "peciailst  technical 

1042  Software  Oesign  Specialist  technical 

1054  Software  Engineering  Specialist  technical 
1059  Supervisor  middle  mgmt 

1062  Supervisor  middle  mgmt 

1063  Chief,  Product  Software  middle  mgmt 

1066  Software  Oesign  Special i st  technical 
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1085  Software  Engineering  Specialist 

1086  Senior  Software  Engineer 
1093  Engineering  Chief 

2005  Supervisor 

2006  Software  Development  Manager 
2012  Senior  System  Analyst 

3002  Software  Management 
3009  Software  Manager 
3013  Engineering  Specialist 
3026  R&D  Engineer 
3029  Digital  Signal  Processing 
3058  Engineering  Specialist 
3060  * 

3061  Senior  Engineering  Specialist 

3070  Engineering  Specialist 

3097  Engineering  Specialist 

4003  Consultant 

4026  Consultant 

4029  Consultant 

4038  Software  Group  Manager 

4044  Programmer  Analyst 

4047  Unit  Manager 

4050  Consultant 

4052  CAD  Development  Manager 

4072  Consultant 


5012  * 

5029  * 

5030  * 

5034  * 

5076  * 

9001  * 


technical 
technical 
middle  mgmt 
middle  mgmt 
middle  mgmt 
technical 
high  level  mgmt 
middle  mgmt 
technical 
technical 
* 

technical 

e 

technical 
technical 
technical 
technical 
technical 
technical 
middle  mgmt 
tccnnical 
middle  mgmt 
technical 
middle  mgmt 
technical 
* 

* 

* 

* 

ft 

* 


development  nonmanager 

1001  Consultant  technical 

1004  Engineering  Software  Supervisor  middle  mgmt 

1012  Software  Oesign  Specialist  ^technical 

1014  Senior  Software  Engineer  technical 

1016  Software  Engineer  technical 

1029  Software  Design  Specialist  technical 

1031  Software  Design  Specialist  technical 

1052  Senior  Engineering  Specialist  technical 

1060  Software  Engineer  technical 

1064  *  * 

1072  *  * 

1074  Software  Design  Specialist  technical 

1075  Software  Design  Specialist  technical 

1078  Senior  Engineer  technical 

1079  Senior  Software  Engineer  technical 

1080  Senior  Software  Engineer  technical 

1082  Senior  Software  Engineer  technical 

1084  Software  Oesign  Specialist  technical 

1030  System  Engineering  Specialist  technical 
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1 09 1  System  Design  Specialist 

technical 

1094 

Software  Engineer 

technical 

1100 

Engineer 

technical 

2001 

Senior  Programmer 

technical 

2002 

Programmer 

technical 

2007 

Senior  Scientific  Programmer 

technical 

2009 

Project  Supervisor 

middle  mgmt 

2011 

Data  Processing  Consultant 

technical 

2013 

Principle  Scientific  Proo>,ammer 

technical 

2014 

Supervising  System  Analyst 

middle  mgmt 

2016 

Scientific  Programmer 

technical 

2018 

Principle  Scientific  Programmer 

technical 

2020 

Principle  Scientif:c  Programmer 

technical 

3001 

Junior  Programme.* 

entry  level 

3004 

Research  Engineer 

technical 

3005 

Senior  Software  Engineer 

technical 

3006 

Supervisor 

middle  mgmt 

3007 

Advanced  RSO  Engineer 

technical 

3010 

Communications  Software 

technical 

3011 

Software  R&D  Engineer 

technical 

3015 

Engineer 

technical 

3018 

Senior  Engineer 

technical 

3023 

* 

* 

3024 

R&D  Engineer 

technical 

3025 

Senior  Engineer 

technical 

3023 

Digital  Signal  Processing 

technical 

3030 

* 

* 

3031 

R&D  Engineer 

technical 

3032 

Engineer 

technical 

3042 

R&D  Engineer 

technical 

3049 

Junior  Programmer 

entry  level 

3051 

Advanced  Development  Engineer 

technical 

3052 

Engineering  Specialist 

technical 

3054 

* 

* 

3062 

* 

* 

3063 

Programmer  Analyst 

technical 

3065 

Programmer 

technical 

3068 

R&0  Engineer 

technical 

3069 

Senior  Engineer 

technical 

3072 

Software  Engineer 

technical 

3074 

Engineer 

technical 

:o77 

Senior  Software  Engineer 

technical 

3078 

R&O  Engineer 

technical 

3080 

Senior  Engineer 

technical 

3085 

'•nior  Engineer 

technical 

3086 

* 

a 

3087 

R&D  Engines 

technical 

3089 

Research  Engineer 

technical 

3091 

Software  Engineer 

technical 

3093 

Engineering  Specialist 

technical 

3034 

Software  Engineer 

technical 

3109 

R&O  Engineer 

technical 

3H1 

Senior  Engineer 

technical 
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3112 

Consultant 

technical 

3H3 

Software  Engineer 

techni cal 

31U 

Software  R&D  Engineer 

technical 

3117 

Engineering  Specialist 

technical 

3119 

R6D  Engineer 

technical 

3120 

Programmer 

technical 

3122 

A 

A 

4002 

Programmer 

technical 

4004 

Programmer  Analyst 

technical 

4005 

Programmer  Analyst 

technical 

4006 

Senior  Applications  Analyst 

technical 

4007 

Staff  Consultant 

technical 

4008 

* 

A 

4015 

Senior  Programmer  Analyst 

technical 

4016 

Senior  Programmer  Analyst 

technical 

4023 

Senior  System  Analyst 

technical 

4024 

Programmer  Analyst 

technical 

4027 

Senior  GS  Analyst 

technical 

4028 

Principle  Programmer  Analyst 

technical 

4032 

Analyst 

technical 

4034 

Government  Program  Analyst 

tociinical 

4035 

Government  Program  Analyst 

technical 

4036 

Principle  Programmer  Analyst 

technical 

4039 

Consul tant 

technical 

4042 

Principle  Systems  Analyst 

technical 

4043 

* 

A 

4045 

Senior  Analyst 

technical 

4048 

Principle  Programmer  Analyst 

technical 

4051 

Firmware  Oesign  Engineer 

technical 

4056 

System  Analyst 

technical 

4058 

* 

A 

4060 

Principle  Engineer 

technical 

4062 

Senior  Programmer  Analyst 

technical 

4063 

* 

A 

4065 

Programmer 

technical 

4067 

Programmer  Analyst 

technical 

4068 

Consultant 

technical 

4069 

Associate  Programmer  Analyst 

entry  level 

4070 

Programmer 

technical 

4073 

Programmer  Analyst 

technical 

4075 

Senior  Engineer 

technical 

4076 

Quality  Assurance  Engineer 

technical 

5001 

* 

A 

5002 

A 

A 

5004 

A 

A 

5005 

A 

A 

5007 

A 

A 

5008 

Diagnostic  Software 

technical 

5011 

A 

A 

5013 

A 

A 

5016 

A 

A 

5021 

A 

A 

5024 

A 

A 
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5026 

* 

A 

5031 

* 

A 

5032 

* 

A 

5038 

A 

A 

5037 

A 

A 

5038 

A 

A 

5043 

A 

A 

5045 

A 

A 

5047 

A 

A 

5048 

A 

A 

5049 

A 

A 

5052 

A 

A 

5053 

A 

A 

5057 

A 

A 

5060 

A 

A 

5063 

A 

A 

5067 

A 

A 

5068 

A 

A 

5069 

A 

A 

5070 

A 

A 

5071 

A 

A 

5072 

A 

A 

5074 

Programmer 

technical 

5078 

A 

A 

5080 

A 

A 

6004 

Dreje=t  Leader 

middle  mgmt 

6005 

A 

A 

6007 

Computer  Scientist 

technical 

6009 

Electronic  Technician 

entry  level 

6010 

Electrical  Engineer 

technical 

6011 

Electrical  Engineer 

technical 

7001 

Computer  Specialist 

technical 

7004 

Computer  Specialist 

technical 

7005 

Computer  Specialist 

technical 

7006 

Computer  Specialist 

technical 

7008 

Computer  Specialist 

technical 

7010 

Computer  Specialist 

technical 

7011 

Computer  Specialist 

technical 

8004 

Team  Leader 

middle  mgmt 

9004 

Electrical  Engineer 

technical 

9005 

Electrical  Engineer 

technical 

;006 

Electrical  Engineer 

technical 

support 

1007 

nonmanager 

Senior  Software  Engineer 

technical 

1009 

Sof tware  Enr '  *eer 

technical 

1010 

Software  Engineer 

technical 

1015 

Software  Engineer 

technical 

1017 

Software  Engineer 

technical 

1026 

Software  Oesign  Specialist 

technical 

1038 

A 

A 

104C 

Software  Oesign  Specialist 

technical 
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1041 

Software  Design  Specialist 

technical 

1043 

Senior  Dynamics  Engineer 

technical 

1044 

Software  Engineer 

technical 

1045 

Software  Engineer 

technical 

1046 

Software  Engineer 

technical 

1048 

Software  Engineering  Specialist 

technical 

1049 

Software  Design  Specialist 

technical 

1050 

Software  Design  Specialist 

technical 

1053 

Software  System  Engineer 

technical 

1055 

* 

A 

1057 

Principle  Engineer 

technical 

1058 

Associate  Engineer 

entry  level 

1065 

Engineering  Manager 

high  level  mgmt 

1076 

Software  Engineer 

technical 

1077 

Electrical  Engineer 

technical 

1087 

Software  Engineering  Specialist 

technical 

1096 

Software  Design  Specialist 

technical 

2003 

Scientific  Programmer 

technical 

2017 

Senior  System  Analyst 

technical 

2023 

Associate  Scientific  Programmer 

entry  level 

3003 

Software  Engineer 

technical 

3008 

Programming  Aide 

entry  level 

3012 

Senior  Engineer 

technical 

3014 

Software  Engineer 

technical 

3020 

R&D  Engineer 

technical 

3027 

Engineering  Specialist 

technical 

3033 

Senior  Engineer 

technical 

3035 

Senior  Engineer 

technical 

3036 

* 

* 

3037 

Software  Engineer 

technical 

3038 

Software  Engineer 

technical 

3039 

* 

A 

3043 

Senior  Engineer 

technical 

3044 

Software  Engineer 

technical 

3045 

* 

* 

3046 

Software  Engineer 

technical 

3047 

* 

* 

3048 

Software  Engineer 

technical 

3050 

R£D  Engineer 

technical 

3053 

Senior  Software  Engineer 

technical 

3059 

Senior  Engineer 

technical 

3064 

Software  Engineer 

technical 

3066 

Senior  Software  Engineer 

technical 

3067 

Software  Engineer 

technical 

3071 

Senior  System  Engineer 

technical 

3073 

Software  Engineer 

technical 

3075 

Software  Engineer 

technical 

3076 

* 

A 

3081 

Software  Engineer 

technical 

3082 

Software  Engineer 

technical 

3084 

Software  Engineer 

technical 

3038 

Senior  Engineering  Specialist 

technical 

3C32 

Senior  Engineer 

technical 
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3093 

Advanced  Research  Engineer 

technical 

3101, 

Software  Engineer 

technical 

3106 

* 

A 

3 107 

Eng i peer 

technical 

3110 

Senior  Software  Engineer 

technical 

3115 

Software  Engineer 

techni ca 1 

3116 

Engineer 

technical 

3H8 

Engineer 

technical 

3122 

Software  Engineer 

techni ca 1 

2,002 

System  Engineer 

technical 

2,009 

Consul tant 

techn i ca 1 

4012 

Principle  Programmer  Analyst 

technical 

1.013 

Software  System  Programmer 

technical 

2,0  2  8 

Electrical 

Eng :  r.aer 

technical 

4029 

Analyst 

technical 

402  2 

Associate 

Applications  Analyst 

entry  level 

4022 

Programmer 

technical 

4031 

Principle 

Programmer 

techn i ca  1 

4040 

System  Programming  Analyst 

technical 

4053 

Programmer 

Analyst 

technical 

4054 

Programmer 

Analyst 

technical 

4057 

Programmer 

technical 

4059 

Programmer 

Analyst 

technical 

4064 

Manager,  Software  Development 

middle  mg mt 

4071 

Programmer 

technical 

40?4 

a 

* 

4077 

Engineer 

technical 

5003 

a 

A 

5006 

* 

A 

5009 

a 

A 

5010 

A 

A 

5014 

a 

A 

5015 

* 

A 

5019 

a 

A 

5020 

* 

A 

5022 

* 

A 

5025 

A 

A 

5027 

A 

A 

5028 

A 

A 

5033 

A 

A 

5033 

A 

A 

;?40 

A 

A 

5042 

Programmer 

technical 

5042 

A 

A 

5044 

‘ 'ogrammer 

technical 

5046 

A 

A 

5050 

* 

A 

5054 

A 

A 

50 55 

A 

A 

5056 

A 

A 

5059 

A 

A 

5062 

A 

A 

5064 

A 

A 

lC9u- 

•2 

C-72 

Ada  Workforce  Survey 


5065 

ft 

* 

5066 

ft 

ft 

5073 

* 

ft 

5075 

It 

* 

5077 

ft 

* 

5079 

ft 

* 

6003 

General  Engineer 

technical 

6006 

Software  Quality  Assurance 

technical 

6008 

Computer  Scientist 

technical 

7002 

Computer  Specialist 

technical 

7003 

Programmer 

techni ca 1 

7007 

Computer  Specialist 

technical 

7012 

Computer  Specialist 

technical 

7013 

Computer  Specialist 

tecn.n  i  ca  1 

7014 

Computer  Specialist 

techn i ca 1 

7015 

Computer  Specialist 

technical 

8001 

Computer  Systems  Analyst 

technical 

8002 

Software  System  Analyst 

techn i ca 1 

8003 

Associate  Programmer  Analyst 

entry  level 

8005 

Computer  Specialist 

techn! cal 

9003 

support 

Mathematician 

manager 

t“ch,-.  ica  i 

1056 

Software  Quality  Assurance 

technical 

106! 

Software  Oesign  Specialist 

technical 

1083 

Software  Design  Specialist 

technical 

1092 

Software  Design  Specialist 

technical 

2019 

Project  Engineer 

technical 

301*0 

ft 

ft 

3057 

Software  Management 

high  level  mgmt 

1*010 

Manager 

middle  mgmt 

4017 

Line  Manager 

middle  mgmt 

1*020 

Manager 

middle  mgmt 

4046 

Software  Development  Manager 

middle  mgmt 

4061 

Manager 

middle  mgmt 

5035 

ft 

ft 

6002  General  Engineer 

technical  manager 

technical 

1081 

ft 

ft 

1088 

Software  Design  Specialist 

technical 

1095 

Senior  Programmer 

technical 

1097 

Software  Design  Specialist 

technical 

1098 

Software  Design  Specialist 

technical 

3099 

Principle  Engineer 

technical 

2001, 

Project  Manager 

middle  mgmt 

2010 

Data  Processing  Consultant 

technical 

2015 

Senior  System  Analyst 

technical 

3034 

Advanced  R60  Engineer 

technical 

3055 

ft 

* 

3056 

R&D  Engineer 

technical 
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3083 

Advanced  R&D  Engineer 

technical 

3090 

Engineering  Manager 

high  level  mgm 

3095 

Engineering  Specialist 

technical 

3102 

Software  Engineer 

technical 

3103 

Engineering  Specialist 

techni ca 1 

1*011 

System  Analyst 

techni ca 1 

1*030 

Consul tant 

technical 

1*037 

Programmer 

techni ca 1 

1.01,1 

Consul tant 

technical 

1*01*9 

Principle  Programmer  Analyst 

technical 

A055 

Senior  Consultant 

technical 

1*066 

Programmer  Analyst 

technical 

5017 

* 

* 

5018 

* 

5023 

* 

* 

5051 

* 

* 

5058 

* 

it 

7009 

Computer  Specialist 

techni cat 

Finally,  the  following  table  presents  the  clusters  versus  the  nine 
companies,  showing  the  internal  distributions  of  job  categories  in  those 
companies.  The  distribution  seems  consistent  with  the  interpretation  of  the 
clusters  aside  from  the  total  lack  of  managers  in  the  public-sector  companies. 

company 

company  three  company  six  company  nine 
company  two  company  five  company  eight 


company  one 

company  four 

company  seven 

administrative  manager 

18 

3 

10 

9 

5 

0 

0 

0 

1 

development  nor-=- ager 

22 

10 

1*7 

35 

36 

6 

7 

1 

3 

support  ncnranag^r 

25 

3 

1*2 

18 

32 

3 

7 

1* 

1 

support  manager 

1* 

1 

2 

5 

1 

1 

0 

0 

0 

technical  manager 

6 

3 

8 

7 

5 

0 

1 

0 

0 

Further  classificat 

ion  of 

nonmanaaement . 

— A I  though 

the 

above 

cl; 

tion  makes  sense,  it  doesn't  have  very  much  to  say  about  those  people  who  will 
be  most  involved  with  Ada  in  the  future,  the  programmer,  the  analyst,  the  sup¬ 
port  personnel,  and  so  on.  Given  that  these  two  c 1 usters — suppor t  and  devel¬ 
opment  nonmanagement--are  of  such  great  interest,  it  may  be  advisable  to  clus¬ 
ter  these  individuals  separately. 
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in  order  to  get  a  clearer  picture,  but  at  the  risk  of  losing  information, 
the  following  clustering  was  done  only  on  the  principal  duties  and  primary 
general  activities  of  the  two  nonmanagement  clusters.  The  results  below  show 
some  distinct  subcategories  in  these  clusters.  It  should  be  borne  in  mind, 
however,  that  these  clusters  are  Drcbably  less  valid  than  the  first  set. 

After  clustering  development  employees  (see  Appendix  3  for  the  tree), 
five  distinct  clusters  emerged  based  on  median  polish  residual  ranks.  These 
clusters  have  the  following  populations: 


Count 

Percent 

c 1 uster 1 

9 

5-4 

cluster3 

17 

10.1 

c  I  usterl* 

131 

78.0 

c 1 uster7 

6 

3-6 

clusterl53 

5 

3-0 

The  f  ol 'owing  median  polish  summarizes  the  properties  of  these  clusters. 

Analysis  of  Clustering  Based  on  Primary  General 
Activities  and  Principal  Duties  of  Development  Employees 

Effects  and  Typicals  after  Polishing 


effects 

common 

2.000 

cluster  1 

1.000 

cluster3 

0.000 

cluster!* 

10.000 

cluster7 

0.000 

cluster  153 

-1.000 

ga  program  management 

-2.000 

ga  sales  marketing 

-2.000 

ga  contract  negotiation 

-2.000 

ga  formulating  policy 

-1.000 

ga  formulating  strategy 

-2.000 

ga  preparing  budgets 

0.000 

ga  technical  management 

1.000 

ga  interv  personnel 

-1.000 

ga  preparing  schedules 

1.000 

ga  prep  mgmt  info  rpts 

-2.000 

ga  prep  fid  eng  rpts 

-2.000 
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ga 

other  admin  tasks 

-2.000 

ga 

tech  advice  to  CCS 

-1.000 

9* 

maint  cortf  ig  procs 

-2.000 

S3 

library  control 

-2.000 

ga 

prep  version  audits 

-2.000 

ga 

quality  assurance 

-2.000 

ga 

prep  temp  eng  rpt 

-2.000 

ga 

prep  technical  rpts 

*  1  .  ** 

33 

reading  tech  pubs 

o.occ 

ga 

reviewing  tech  work 

3.000 

S« 

teaching 

0.000 

ga 

updat  training  man 

-1.000 

ga 

being  trained 

-1.000 

ga 

func  system  design 

*..000 

ga 

func  module  design 

5.000 

ga 

def  glob  data  strucs 

3. coo 

ga 

def  subsys  interface 

3.000 

ga 

def  stuff  for  own  use 

5.000 

ga 

coding 

5.000 

S3 

debug  or  modifying 

5. coo 

ga 

prep  sys  rqt  docs 

1.000 

ga 

updat  MIL  STD  specs 

-1.000 

ga 

prep  red  lined  docs 

1.000 

ga 

prep  vers  descr  mnls 

-1.000 

ga 

prep  user  manuals 

0.000 

3~ 

documenting  cede 

•*  •  w 

ga 

defining  test  cases 

1.000 

ga 

prep  test  drivers 

0.000 

ga 

prep  test  plans 

2.000 

ga 

hardware  testing 

-2.000 

ga 

system  software  test 

3.000 

ga 

def  mod  test  cases 

5.000 

ga 

software  module  test 

5.000 

ga 

doc  test  results 

0.000 

ga 

prep  trouble  recurts 

2.000 

ga 

anal  trouble  r  ,cs 

1.000 

pd 

conduct  rsq  review 

1.000 

pd 

attend  req  review 

k.000 

pd 

system  analysis 

A.  000 

pd 

design 

4.000 

conduct  design  review 

3.000 

pa 

..ttsnd  design  review 

5.000 

pd 

ccce 

5.000 

pd 

conduct  walkthroughs 

1*.000 

Dd 

atten*.  'alkihroughs 

k.000 

pd 

formulation  cf  policy 

o.coo 

pd 

formulating  strat..,/ 

0  coo 

pd 

technical  management 

2.000 

pa 

program  management 

-2.000 

pd 

configuration  mngmnt 

-2.000 

pd 

quality  assurance 

-1.000 

pd 

monitoring  contracts 

-2.00C 

pd 

other  development 

-2.000 

Ada  Workforce  Survey 


Page  75* 


pd  support  analysis  5*000 
pd  support  design  3*000 
pd  conduct  support  ar  1.000 
pd  attend  support  dr  2.000 
pd  code  patch  6*000 
pd  conduct  sup  walkthru  -1.000 
pd  attend  sup  walkthru  -1.000 
pd  sup  technical  mgmt  1.000 
pd  sup  formulate  policy  -1.000 
pd  sup  program  mgmt  -2.000 
pd  SCCB  participation  1.000 
pd  sup  config  management  -2.000 
pd  sup  quality  assurance  -1.000 
pd  sup  monitor  contracts  -2.000 
pd  other  support  -2.000 


Residuals  after  Polishing 


ga  contract  negotiation 

ga  preparing  budgets 

ga  sales  marketing 

ga  formulating 

strategy 

ga  interv  personnel 

ga  program  management 

ga  formuiatir; 

pci  icy 

ga  technical  management 

cluster  1 

0.000 

1.000 

0.000 

1.000 

0.000 

0.000 

-3*000 

0.000 

cluster3 

0.000 

0.000 

0.000 

-1.000 

0.000 

0.000 

0.000 

0.000 

cluster!* 

-7.000 

-10.000  - 

10.000 

-8*000 

-1.000 

-it.OOO 

16.000 

-8.000 

cluster? 

2.000 

0.000 

0.000 

0.000 

2.000 

1.000 

2.000 

0.000 

cluster  153 

1.000 

1.000 

1.000 

1.000 

2.000 

-1.000 

-1.000 

2.000 

ga 

prep  version  audits 

ga  prep 

fid  eng  rpts 

ga  maint  config  procs 

ga  prep  mgmt  info  rpts 

ga  tech 

adv i ce 

to  CCB 

ga  preparing  schedules 

ga  other  admin 

tasks 

ga  1 ibrary  control 

cluster  1 

-i*.000 

0.000 

-1.000 

0.000 

0.000 

0.000 

-1.000 

-1.000 

cluster3 

0.000 

0.000 

0.000 

1.000 

-1.000 

0.000 

0.000 

0.000 

cluster!* 

3.000 

0.000 

-9*000 

-10.000 

-2.000 

-7.000 

-7.000 

-8.000 

cluster7 

0.000 

3.000 

0.000 

0.000 

1.000 

0.000 

0.000 

0.000 

cluster  153 

-1.000 

1.000 

1.000 

3.000 

2.000 

3.000 

3-000 

2.000 

ga  prep 

technical  rpts 

ga  updat  training  man 

ga  prep  temp  eng  rpt 

ga  reviewing  tech  work 

ga  quality  assurance 

ga  reading  tech 

i  pubs  ga  teaching  ga  being  trained 

cluster  1 

-1.000 

2.000 

0.000 

1.000 

-3*000 

-1.000 

0.000 

2.000 

cluster3 

0.000 

0.000 

0.000 

0.000 

-1.000 

1.000 

0.000 

1.000 

cluster!* 

-u.ooo 

-1.000 

0.000 

0.000 

10.000 

-5.000 

-8.000 

-2.000 

cluster7 

2.000 

0.000 

2.000 

0.000 

0.000 

0.000 

-1.000 

0.000 

cluster  153 

1*.000 

2.000 

0.000 

2.000 

0.000 

0.000 

0.000 

0.000 
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ga  prep  sys  rqt  docs 

ga  def  glob  data  strucs  ga  coding 

ga  func  module  design  ga  def  stuff  for  own  use 


ga  func 

system 

des i gn 

ga  def  subsys  interface 

ga  debug  or  modifying 

cluster  1 

-1.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

cluster3 

4.000 

6.000 

7.000 

3.00c 

4.000 

6.000 

6.000 

-1.000 

cluster^ 

56.000 

73.000 

'4  3-OCC 

56.000 

53.000 

61.000 

62.000 

20.000 

cluster? 

0.000 

-4.  000 

0.000 

-1.000 

-1.000 

-5.000 

-5.000 

1.000 

cluster  153 

-2.000 

-6.000 

-A. 000 

-3.000 

-6.000 

-6.000 

-6.000 

-1.000 

ga  prep 

vers  descr  mnls 

ga  defining  test 

cases 

ga  prep  redlirsd  docs 

ga  documenting 

code 

ga  prep 

test  plans 

ga  updat 

MIL  STD  specs 

0-i  prep 

user  manuals 

ga  prep 

test  drivers 

cluster  1 

2.000 

-1.000 

2.000 

2.000 

2.000 

3.000 

3.000 

1.000 

cluster3 

0.000 

-1.000 

-1.000 

-2.000 

C.COO 

-1.000 

-1.000 

0.000 

cluster^ 

-5.000 

0.000 

-4. 000 

4.000 

49-000 

25.000 

17.000 

29.000 

cluster7 

0.000 

0.000 

0.000 

0.000 

-5.000 

0.000 

0.000 

-1.000 

cluster  153 

1.000 

1.000 

2.000 

0.000 

-3.000 

-2.000 

-1.000 

-1.000 

ga  def 

mod  test 

cases 

ga  prep 

trouble 

reports 

ga  system  software  test 

ga  doc  test  results  pd 

conduct 

req  review 

ga  hardware  testing 

ga  software  module  test 

ga  anal 

trouble 

rpts 

cluster  1 

2.000 

0.000 

0.000 

0.000 

5.0G0 

1.000 

3.000 

-2 .000 

c!uster3 

0.000 

5.000 

3.00c 

6.000 

-1.000 

0.000 

0.000 

2.000 

clusterl* 

0.000 

55.000 

32.000 

47.000 

15.000 

13.000 

19.000 

16.000 

cluster? 

0.000 

-2.000 

-7.000 

-7.000 

0.000 

-3.000 

-2.000 

0.000 

cluster  153 

2.000 

-3.000 

-5.000 

-5.000 

0.000 

-1.000 

0.000 

-1.000 

pd  attend  walkthroughs 

pd  conduct  design  review 

pd  conduct  walkthroughs 

pd  system  analysis 

pd  attend  design  review 

pd  attend  req 

revi ew 

pd  design 

pd  code 

cluster  1 

-3.CC0 

-2.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

cluster3 

4.  000 

4.000 

1 1.000 

10.000 

9.000 

9.000 

9.000 

10.000 

clusterk 

35.000 

56.000 

87-000 

39-000 

47.000 

78-000 

28.000 

31.000 

cluster? 

-2 .000 

-1.000 

-2.000 

-3.000 

-4.000 

-4.000 

-5.000 

-4.000 

-luster  153 

0.000 

0.000 

o.ooc 

-2.000 

-3.000 

-6.000 

-4.000 

-4.000 

pd  other 

development 

pd  technical  management 

pd  quality  assurance 

pd  formulating 

strategy 

pd  configuration  mngmnt 

pd  fc'-ulation  of  policy 

pd  program  management 

pd  monitoring  contracts 

cluster  1 

-2.000 

’.000 

-4*200 

-1.000 

0.000 

-2.000 

- 1 .000 

-1.000 

c!uster3 

0.000 

1.000 

0.000 

0.000 

1.000 

0.000 

0.000 

0.000 

cluster^ 

-8.000 

0.000 

11.000 

-5.000 

-3.000 

-3.000 

-4.000 

-9-000 

cluster? 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

clusterl53 

1.000 

1.000 

1.000 

4.000 

4.000 

5-000 

6.000 

1.000 
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pd  conduct  support  dr  pd  conduct  sup  walkthru 
pd  support  design  pd  code  patch  pd  sup  technical  mgmt 

pd  support  analysis  pd  attend  support  dr  pd  attend  sup  walkthru 


cluster  1 

0.000 

0.000 

k.ooo 

1*.000 

0.000 

6.000 

7.000 

-3.000 

cluster3 

5.000 

11.000 

12.000 

10.000 

6.000 

lk. ooo 

13.000 

2.000 

cluster!* 

10.000 

2.000 

-8.000 

0.000 

0.000 

-8.000 

-1.000 

-5.000 

cluster7 

-1.000 

0.000 

-3.000 

-k.ooo 

-6-000 

-1.000 

0.000 

0.000 

cluster  153 

-1.000 

-1.000 

0.000 

0.000 

-6.000 

0.000 

0.000 

2.000 

pd  sup  conf i g  management 

pd  SCCB  partic 

i pat  ion 

pd  other  support 

pd  sup 

program  mgmt 

pd  sup  monitor  contracts 

pd  sup 

formulate 

pot i cy 

pd  sup  quality  assurance 

clusterl 

0.000 

-1.000 

-2.000 

0.000 

-1.000 

-1.000 

-1.000 

c luster3 

0.000 

0.000 

0.000 

0.000 

1 .000 

0.000 

0.000 

c  luster!* 

-8-000  - 

10.000 

0.000 

-6.000 

-k.000 

-5-000 

-5.000 

c luster7 

0.000 

1.000 

-3.000 

0.000 

0.000 

0.000 

0.000 

clusterl53 

2.000 

3.000 

2.000 

k.ooo 

5-000 

5-000 

1.000 

Categories  with  High  Positive 
Residuals  in  Rank  Order 

Cluster  1 


ga  being  trained 

1.000 

pd  conduct  req  review 

1.000 

ga  updat  MIL  STD  specs 

1.000 

pd  attend  req  review 

1.000 

ga  prep  temp  eng  rpt 

1.500 

pd  system  analysis 

1.000 

ga  sales  marketing 

1.500 

ga  technical  management 

1.000 

ga  hardware  testing 

1.500 

pd  formulating  strategy 

1.000 

ga  prep  vers  descr  mnls 

1.500 

ga  preparing  schedules 

1.000 

ga  formulating  policy 

1.500 

pd  technical  management 

1.000 

ga  prep  test  drivers 

2.000 

ga  reviewing  tech  work 

1.000 

ga  prep  trouble  reports 

2.000 

ga  prep  red  lined  docs 

1.500 

ga  reading  tech  pubs 

2.000 

ga  prep  fid  eng  rpts 

2.000 

ga  updat  training  man 

2.000 

pd  other  development 

2.000 

ga  anal  trouble  rpts 

2.000 

pd  monitoring  contracts 

2.000 

pd  conduct  sup  walkthru 

2.000 

pd  quality  assurance 

2.000 

pd  attend  support  dr 

2.000 

ga  prep  mgmt  info  rpts 

2.000 

ga  prep  user  manuals 

2.000 

pd  SCCB  participation 

2.000 

ga  doc  test  results 

2.000 

pd  formulation  of  policy 

2.000 

pd  conduct  support  dr 

2.000 

pd  sup  quality  assurance 

2.000 

pd  attend  sup  walkthru 

2.000 

pd  sup  monitor  contracts 

2.000 

ga  documenting  code 

2.000 

pd  other  support 

2.000 

ga  defining  test  cases 

2.000 

ga  library  control 

2.000 

ga  prep  test  plans 

2.000 

pd  program  management 

2.000 

ga  preparing  budgets 

2.500 

ga  prep  version  audits 

2.000 

pd  code  patch 

2.500 

ga  quality  assurance 

2.000 

ga  prep  sys  rqt  docs 

3.000 

ga  teaching 

2.000 

ga  coding 

3.000 

pd  sup  program  mgmt 

2.000 

ga  system  software  test 

3.000 

od  sup  technical  mgmt 

2.000 

ga  def  stuff  for  own  use 

3.000 

ga  func  system  design 

2.000 
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ga  contract  negotiation 
ga  debug  or  modifying 
ga  def  mod  test  cases 
pd  conduct  design  review 
ga  software  module  test 
pd  attend  design  review 
pd  code 

pd  conduct  walkthroughs 
pd  attend  walkthroughs 
pd  suoport  analysis 
ga  def  subsys  interface 
ga  func  module  design 
ga  maint  config  orocs 
ga  tech  advice  to  CCB 
ga  interv  personnel 
pd  sup  formulate  policy 
pd  sup  config  management 


3-000  ga  formulating  strategy 

3-000  pd  configuration  mngmnt 

3-000  pd  support  design 

3-000  pd  design 

3-000  ga  def  glob  data  strucs 

3-000  ga  other  admin  tasks 

3-000  ga  prep  technical  rpts 

3-00C  ga  program  management 

3-000  ga  system  software  test 

3-000  pd  attend  design  review 

3-000  ga  software  module  test 

3-000  pd  conduct  walkthroughs 

3-000  ga  pr-p  sys  rqt  docs 

3-000  ga  coding 

3-000  od  attend  walkthroughs 

3-000  ga  maint  config  procs 

3-000  ga  def  subsys  interface 

ga  tech  advice  to  CCB 
pd  support  analysis 
pd  code 

pd  conduct  design  review 
ga  func  module  design 
pd  sup  formulate  policy 
ga  def  mod  test  cases 
ga  interv  personnel 
?d  sup  config  management 
ga  debug  or  modifying 
ga  contract  negotiation 
ga  def  stuff  for  own  use 

Cluster  3 


pd  support  design  1.000 
ga  teaching  1.000 
pd  conduct  support  dr  1.000 
pd  attend  suppr't  ar  1.000 
pd  code  patch  1.000 
pd  attend  sup  walkthru  1.000 
pd  conduct  sup  walkthru  1.000 
pd  sup  te;hnical  mgmt  1-500 
cd  formulating  strategy  1-500 
So  ether  admin  tasks  2.000 
pd  attend  walkthroughs  2. COO 
pd  sup  ouality  assurance  2.000 
ga  uodat  -aining  man  2.000 
ga  being  trained  2.000 
ga  func  system  desig  2-OOu 
ga  func  module  design  2.000 
ga  def  giob  data  strucs  2.000 
ga  def  subsys  interface  2.000 
ga  def  stuff  for  own  use  2.000 
ga  coding  2.000 
ga  debug  or  modifying  2.000 


ga  doc  test  results 
ga  prep  user  manuals 
ga  prep  test  drivers 
ga  prep  sys  rqt  docs 
ga  prep  red  lined  docs 
ga  formulating  policy 
ga  reviewing  tech  work 
ga  hardware  testing 
ga  defining  test  cases 
ga  prep  mgmt  info  rpts 
ga  reading  tech  pubs 
ga  tech  advice  to  CCB 
ga  prep  vers  descr  mnls 
ga  prep  temp  eng  rpt 
8*  prep  technical  rpts 
ga  anal  trouble  rpts 
pd  technical  management 
ga  updat  Ml L  ST0  specs 
ga  formulating  strategy 
ga  sales  marketing 
ga  program  management 


2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2-500 

3.000 

3.000 

3.000 

3-000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3-000 

3-000 

3.000 

3.000 

3.000 


1-000 

1.000 

1.500 

1.500 

1.500 
2.000 
2.000 
2.000 
2.000 
2.000 
2.000 
2.000 
2.000 

2.500 
2.500 
2.500 
2.500 
2.500 
2.500 
2.500 
2.500 
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pd  configuration  mngmnt 

2.000 

ga 

contract  negotiation 

3.000 

od  support  analysis 

2.000 

9* 

maint  config  procs 

3.000 

ga  system  software  test 

2.000 

ga 

prep  test  plans 

3.000 

ga  def  mod  test  cases 

2.000 

ga 

prep  trouble  reports 

3-000 

ga  software  module  test 

2.000 

ga 

quality  assurance 

3.000 

pd  conduct  walkthroughs 

2.000 

ga 

documenting  code 

3.000 

pd  conduct  req  review 

2.000 

ga 

interv  personnel 

3.000 

pd  attend  req  review 

2.000 

ga 

technical  management 

3.000 

pd  system  analysis 

2.000 

pd 

sup  formulate  policy 

3.000 

pd  design 

2.000 

pd 

sup  program  mgmt 

3.000 

pd  conduct  design  review 

2.000 

Pd 

sup  config  management 

3.000 

pd  attend  design  review 

2.000 

pd  code 

2.000 

pd  other  development 

2.500 

pd  SCCB  participation 

2.500 

pd  formulation  of  policy 

2.500 

ga  preparing  budgets 

2.500 

pd  other  support 

2.500 

pd  program  management 

2.500 

pd  quality  assurance 

2.500 

pd  monitoring  contracts 

2.500 

• 

pd  sup  monitor  contracts 

2.500 

ga  prep  version  audits 

2.50C 

ga  library  control 

2.500 

ga  preparing  schedules 

2.500 

ga  prep  fid  eng  rpts 

2.500 

ga  prep  test  plans 

3.000 

ga  documenting  code 

3.000 

ga  quality  assurance 

3.000 

ga  maint  config  procs 

3.000 

pd  sup  formulate  policy 

3.000 

pd  sup  program  mgmt 

3.000 

ga  interv  personnel 

3.000 

pd  sup  config  management 

3.000 

ga  technical  management 

3.000 

ga  prep  trouble  reports 

3.000 

ga  contract  negotiation 

3-000 

Clutter  A 


ga 

technical  management 

1.000 

ga  program  management 

1.000 

g* 

preparing  schedules 

1.000 

ga  sales  marketing 

1.000 

ga 

reviewing  tech  work 

1.000 

ga  contract  negotiation 

1.000 

g* 

func  system  design 

1.000 

ga  formulating  policy 

1.000 

ga 

func  module  design 

1.000 

ga  formulating  strategy 

1.000 

ga 

def  glob  data  strucs 

1.000 

ga  preparing  budgets 

1.000 

ga 

def  subsys  interface 

1.000 

ga  interv  personnel 

1.000 

g* 

def  stuff  for  own  use 

1.000 

pd  attend  sup  walk thru 

1.000 

ga 

coding 

1.000 

ga  prep  fid  eng  rpts 

1.000 

ga  debug  or  modifying 

1.000 

ga  other  admin  tasks 

1.000 

ga 

prep  sys  rqt  docs 

1.000 

ga  tech  advice  to  CCI 

1.000 

Pd 

system  analysis 

1.000 

ga  maint  config  procs 

1.000 

ga 

prep  user  manuals 

1.000 

ga  library  control 

1.000 
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5*  documenting  code  1.000 
ga  defining  teat  cases  1.000 
ga  prep  test  drivers  1.000 
ga  prep  test  plans  1.000 
ga  system  software  test  1.0C0 
ga  def  mod  test  cases  1.000 
ga  software  module  test  1.000 
ga  doc  test  results  1.C0C 
ga  prep  trouble  reports  1.000 
ga  anal  trouble  rpts  1.000 
pd  conduct  req  review  1.000 
pd  attend  req  review  1.000 
pa  attend  walkthroughs  1.000 
pd  des i gn  j . ooo 
pd  conduct  design  review  1.000 
od  attend  design  review  1.000 
Pd  code  1.000 
od  conduct  walkthroughs  1.000 
pd  technical  management  1.000 
pd  support  analysis  1.000 
pd  support  design  2.000 
ga  prep  red  lined  docs  2.p00 
pd  cod-  patch  2.5CO 
pd  SCC8  participation  2.500 


Cluster 


ga  preparing  budgets  1.000 
ga  prep  mgmt  info  rpts  1.000 
ga  program  management  l.OCO 
ga  prep  technic?!  -pts  1.000 
ga  formulating  s  ,-ategy  1.500 
Pd  sup  program  mgmt  2.000 
ga  technical  management  2.000 
ga  tech  ary ice  to  CC8  2.000 
c*  pren  sys  rqt  docs  2.000 
5-  'yciity  assurance  2.000 
pd  otner  deve'opment  2.500 
ga  preparing  schedules  2-500 
pd  sup  m.:  : tor  contracts  2.500 
ga  prep  flu  eng  rpts  2. 500 
pd  program  managemen  ?-5*'v 
ga  library  control  2.500 
ga  prep  version  audits  2.J00 
ga  teaching  2.500 
ga  pr«o  rad  lined  docs  2.500 
Pd  formulation  of  policy  2.500 
pd  menito-ing  contracts  2.500 


ga  prep  version  audits  1.000 
ga  quality  assurance  1.000 
ga  orep  temp  eng  rpt  1.000 
ga  oreD  vers  descr  mnls  1.000 
3a  uDdat  MIL  STD  specs  1.000 
ga  teaching  1.000 
ga  updat  training  man  1.000 
ga  bring  trained  1.000 
pd  other  support  1.00C 
pa  sup  monitor  contracts  1.000 
pd  sup  Quality  assurance  1.000 
pd  formulation  of  policy  1.000 
Pd  sun  arogram  mgmt  1.000 
Pd  diagram  management  1.000 
?c  configuration  mngmnt  1.000 
pd  quality  assurance  1.000 
pd  monitoring  contracts  1.000 
pd  other  development  1.000 
pd  cenouct  support  dr  1.000 
pd  conduct  sup  walk  thru  1.000 
pd  sup  technical  mgmt  1.000 
pd  sup  formulate  policy  1.000 
pd  sup  config  management  1.000 
ga  prep  mgmt  info  rpts  2.000 
ga  hardware  testing  2.000 
ga  mad irg  tech  pubs  2.000 
pd  atteno  support  dr  2.500 
pd  formulating  strategy  2.500 
ga  prep  technical  rpts  2.500 

7 

ga  anal  trouble  rpts  1.000 
ga  prep  trouble  reports  1.000 
pd  SCCB  participation  1.000 
ga  def  mod  test  cases  1.000 
pd  attend  support  dr  1.000 
ga  documenting  code  1.000 
pd  attend  design  review  1.000 
pd  conduct  design  review  1.000 
pd  conduct  walkthroughs  1.000 
pd  design  1.000 
ga  software  module  test  1.000 
pd  support  analysis  1.500 
ga  prep  test  plans  1.500 
pd  attend  walkthroughs  1.500 
pd  code  patch  1.500 
ga  func  module  design  2.000 
ga  def  subsys  interface  2.000 
ga  daf  stuff  for  own  use  2.000 
ga  debug  or  modifying  2.000 
pd  system  analysis  2.000 
pd  conduct  support  dr  2.000 
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pd  quality  assurance 
ga  reviewing  tech  work 
pd  other  support 
pd  conduct  req  review 
ga  defining  test  cases 
ga  maint  config  procs 
ga  prep  vers  descr  mnls 
ga  func  system  design 
ga  interv  personnel 
pd  sup  technical  mgmt 
pd  sup  formulate  policy 
ga  formulating  policy 
pd  sup  conf i g  management 
pd  sup  quality  assurance 
ga  contract  negotiation 
ga  prep  test  drivers 


2.500 

2.500 

2.500 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 

3.000 


Cluster 


pd  code 

pd  conduct  sup  walkthru 
ga  cod i n g 

ga  hardware  testing 
ga  system  software  test 
ga  reading  tech  pubs 
pd  attend  req  review 
ga  updat  training  man 
pd  technical  management 
pd  configuration  mngmnt 
ga  other  admin  tasks 
pd  formulating  strategy 
ga  prep  user  manuals 
ga  updat  MIL  STD  specs 
ga  def  glob  data  strucs 
pd  attend  sup  walkthru 
ga  being  trained 
ga  prep  temp  eng  rpt 
pd  support  design 
ga  doc  test  results 
ga  Si i es  marketing 
ga  interv  personnel 
ga  contract  negotiation 
ga  maint  config  procs 
pd  sup  technical  mgmt 
ga  prep  test  drivers 
ga  defining  test  cases 
ga  prep  vers  descr  mnls 
ga  func  system  design 
pd  conduct  req  review 
pd  sup  formulate  policy 
ga  formulating  policy 
pd  sup  config  management 
pd  sup  quality  assurance 

153 


2.000 

2.000 

2.000 

2.000 

2.000 

2.000 

2.000 

2.000 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

2.500 

3-000 

3-000 

3-000 

3-000 

3-000 

3-000 

3.000 

3-000 

3.000 

3-000 

3-000 

3-000 

3-000 


pd  other  support  1 .000 
pd  sup  monitor  contracts  1.000 
ga  contract  negotiation  1.000 
pd  sup  config  management  1.000 
pd  SCC8  participation  1.000 
ga  interv  personnel  1.000 
pd  sup  formulate  policy  1.000 
ga  prep  fid  eng  rpts  1.000 
ga  other  admin  tasks  1.000 
ga  tech  advice  to  CC8  1.000 
ga  maint  config  procs  1.000 
ga  library  control  1.000 
ga  prep  version  audits  1.000 
ga  reading  tech  pubs  1.000 
ga  quality  assurance  1.000 
ga  prep  redlined  docs  1.000 


ga  debug  or  modifying  1.000 

ga  system  software  test  1.000 

pd  support  design  i.000 

ga  defining  test  cases  1.000 

'od*  1.000 

ga  func  system  design  1.000 

ga  func  module  design  1.000 

ga  def  glob  data  strucs  1.000 

ga  def  subsys  interface  1.000 

ga  def  stuff  for  own  use  1.000 

cod,n8  1.000 

9*  prep  test  plans  I.500 

pd  code  patch  1.500 

ga  prep  test  drivers  1.500 

pd  a t tend  walkthroughs  1.500 

Pd  support  analysis  I.500 
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pd  other  development 

1 .000 

ga 

prep  sys  rot  docs 

1.500 

pd  monitoring  contracts 

1.000 

ga 

preparing  budgets 

2.000 

pd  sup  program  mgmt 

1.000 

pd 

conduct  walkthroughs 

2.000 

pd  configuration  mngmnt 

1.000 

ga 

def  mod  test  cases 

2.000 

pd  program  management 

1.000 

pd 

conduct  req  review 

2.000 

pd  formulation  of  policy 

1 .000 

ga 

software  module  test 

2.000 

pd  sup  quality  assurance 

!  .000 

ga 

prep  trouble  reports 

2.000 

pd  quality  assurance 

!  .0CC 

pd 

conduct  design  review 

2.000 

ga  hardware  testing 

i  .50c 

ga 

technical  management 

2.000 

ga  prep  vers  descr  mnls 

1.500 

ga 

preparing  schedules 

2.000 

pd  formulating  strategy 

1.500 

pd 

attend  design  review 

2.000 

pd  sup  technical  mgmt 

1.500 

ga 

documenting  code 

2.000 

ga  prep  temp  eng  rpt 

1 . 500 

ga 

dec  test  results 

2.5C0 

ga  formulating  policy 

i  • 

Pd 

attend  support  dr 

2.500 

ga  formulating  strategy 

1.500 

52 

anal  trouble  rpts 

2.500 

ga  sales  marketing 

1.500 

ga 

prep  user  manuals 

2.500 

ga  program  management 

2.000 

ga 

being  trained 

2.500 

pd  technical  management 

2.000 

ga 

prep  technical  rpts 

2.500 

ga  prep  mgmt  info  rpts 

2.000 

pd 

des i gn 

2.500 

ga  updat  MIL  STD  specs 

2.000 

pd 

attend  sup  walkthru 

2.500 

ga  updat  training  man 

2.000 

pd 

conduct  support  dr 

3.000 

ga  teaching 

2.500 

pd 

system  analysis 

3-000 

ga  reviewing  tech  work 

2.500 

pd 

attend  req  review 

3.000 

pd  conduct  support  dr 

3.000 

pd 

conduct  sup  walkthru 

3.000 

pd  conduct  sup  walkthru 

3.  coo 

pd  system  analysis 

1  «*#■*** 

.  vvv 

pd  attend  req  review 

3.000 

{insert  analysis  summary  here} 

The  support  employees  were  clustered  (see 
clusters,  and  these  were  distributed  according 


Coe-  t 

Percent 

cluster  1 

7* 

56-9 

c!uster7 

*3 

33.1 

dusterll* 

13 

10.0 

Appendix  3)  into  three 
to  the  following  table: 


The  following  median  polish  summarizes  the  properties  of  these  clusters. 

Analysis  .*  Clustering  Based  on  Primary  General 
Activities  and  ?r<ncioal  Duties  of  Support  Employees 

Effects  and  Typicals  after  Polishing 

effects 

common  2.000 
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cluster  1 

1.000 

cluster? 

0.000 

cluster  li* 

-1.000 

ga 

program  management 

-1.000 

ga 

sales  marketing 

-1.000 

ga 

contract  negotiation 

-2.000 

ga 

formulating  pol icy 

-1 .000 

ga 

formulating  strategy 

-1.000 

ga 

preparing  budgets 

1.000 

ga 

technical  management 

2.000 

ga 

interv  personnel 

-2.000 

ga 

preparing  schedules 

-1.000 

ga 

prep  mgmt  info  rpts 

0.000 

ga 

prep  fid  eng  rpts 

-2.000 

ga 

other  admin  tasks 

-1.000 

ga 

tech  advice  to  CCS 

-1.000 

ga 

maint  config  procs 

-1.000 

ga 

library  control 

-1.000 

ga 

prep  version  audits 

-2.000 

ga 

quality  assurance 

0.000 

ga 

prep  temp  eng  rpt 

-1.000 

ga 

prep  technical  rpts 

0.000 

ga 

reading  tech  pubs 

0.000 

ga 

reviewing  tech  work 

1.000 

ga 

teach i ng 

1.000 

ga 

updat  training  man 

-1.000 

ga 

being  trained 

3.000 

ga 

func  system  design 

13.000 

ga 

func  module  design 

13.000 

ga 

def  glob  data  strucs 

1.000 

ga 

def  subsys  interface 

1.000 

ga 

def  stuff  for  own  use 

3.000 

ga 

cod i ng 

2.000 

ga  debug  or  modifying 

5.000 

ga 

prep  sys  rqt  docs 

2.000 

ga 

updat  MU  STD  specs 

-2.000 

ga 

prep  redlined  docs 

0.000 

ga 

prep  vers  descr  mnls 

-1.000 

ga 

prep  user  manuals 

-1.000 

ga 

document i ng  code 

2.00  0 

ga 

defining  test  cases 

4.000 

ga 

prep  test  drivers 

0.000 

ga 

prep  test  plans 

4.000 

ga 

hardware  testing 

-1.000 

ga 

system  software  test 

8.000 

ga 

def  mod  test  cases 

0.000 

ga 

software  module  test 

2.000 

ga 

doc  test  results 

5.000 

ga 

prep  trouble  reports 

5.000 

ga 

anal  trouble  rpts 

3.000 

pd 

conduct  req  review 

1.000 

Pd 

attend  req  review 

7.000 

V 
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pd 

system  analysis 

9.000 

pd 

des i gn 

1 1  .CCC 

PC 

co-duct  design  review 

1.000 

pc 

attend  design  review 

6 .000 

pd 

code 

7.0C0 

Pd 

conduct  walkthroughs 

0.000 

Pd 

attend  walkthroughs 

3.00C 

pd 

formulation  of  policy 

«  *  ^  r  r. 

pd 

formulating  strategy 

-l.ocr 

Pd 

technical  management 

0.000 

pd 

program  management 

- 1 .000 

pd 

conf  i  gurat  i  on  mngm.-r 

-:.coo 

od 

qua  1 i ty  assurance 

o.eoo 

pd 

monitoring  contracts 

: .  w^c 

Pd 

other  development 

-1.000 

pd 

support  analysis 

5.000 

pd 

support  design 

2.000 

pd 

conduct  support  dr 

0.000 

pd 

attend  support  dr 

5.C0C 

pd 

code  patch 

3.000 

Pd 

conduct  sup  walkthru 

-1 .000 

pd 

attend  sud  walkthru 

2.  COO 

pe 

sup  technical  mgmt 

0.000 

Pd 

sup  formulate  policy 

-2.000 

pd 

sup  program  mgmt 

-2.000 

.« 

fcri.2t'cr. 

-  •  — 

pd 

sup  config  management 

0.000 

pd 

sup  quality  assurance 

c.coo 

pd 

sup  monitor  contracts 

1.000 

pd 

other  support 

-1.000 

Residuals  after  Polishing 

ga 


sa 

progrs-  - 


ga  contract 
s«.  '  es  marKet:ng 
;nagement  ga 


negotiation  ga  preparing  budgets 
t  ca  formulating  strategy  ga  interv  personnel 
formulating  policy  ga  technical  management 


cluster l 

cluster? 
cluster R 


2.000 

0.000 

1.000 


-2.000 

0.000 

0.000 


■1.000 
0.000 
1 .000 


■2.000 

0.000 

0.000 


1.000 

0.000 

0,000 


-1*  .000 
0.000 
0.000 


-3.000  -i.ooo 
0 . 000  0 . 000 
3.000  3.000 


ga  prep  version  audits 

S3  prep  tip  eng  rpts  ga  walnt  config  procs 
ga  orep  mgmt  info  rpts  ga  tech  advice  to  CCS 
ga  P' -Daring  schedules  ga  other  admin  tasks  ga  library  control 


c 1  us  ter  l 

cluste-7 

c 1  us  ter  R 


-1.000  ,  .000 
0 .000  O.uOO 
2. COO  0.000 


l.'-vC  -2.000 
0.000  1.000 
1.000  0.000 


-2.000  -1.000 

1.000  0.000 

0.000  0.000 


-2.000  0.000 

0.000  0.000 

1.000  1.000 
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ga  prep  technical  rpts  ga  updat  training  man 


ga  prep 

temp  eng  rpt 

ga  reviewing  tech  work 

ga  quality  assurance 

ga  read 

i ng  tech 

pubs  ga 

teaching  ga  being  trained 

cluster  1 

-3-000 

-1.000 

-1.000 

0.000 

0.000 

0.000 

-2.000 

0.000 

cluster7 

0.000 

1.000 

2.000 

0.000 

-1.000 

1 .000 

1 .000 

0.000 

cluster  14 

0.000 

0.000 

0.000 

it. 000 

6.000 

-2.000 

0.000 

-2.000 

ga  def 

glob  data 

strucs 

ga  coding 

ga  func 

module 

design  ga  def  stuff  for 

own  use 

ga  prep 

sys  rqt  docs 

ga  func 

system 

des  i  gn 

ga  def  subsys  interface 

ga  debug  or  mod 

i f y i ng 

clusterl 

0.000 

2  it  .000 

20.000 

24.000 

36-000 

63-000 

63-000 

2.000 

clustery 

0.000 

O.COO 

-1.000 

0.000 

0.000 

0.000 

0.000 

-2.000 

c  1  uster  lit 

-9-000  - 

11.000 

0.000 

-1.000 

-3.000 

-3.000 

-6-000 

0.000 

ga  prep 

vers  descr  mnls 

ga  defining  test 

cases 

ga  prep 

redl i ned  docs 

ga  documenting 

code 

ga  prep  test  plans 

ga  updat 

MIL  STD 

specs 

ga  prep 

user  manuals 

ga  prep 

test  drivers 

cluster  1 

0.000 

0.000 

3.000 

6.0CC 

ji .000 

3.000 

3-000 

6.000 

c Iuster7 

0.000 

-1.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

cluster  14 

2.000 

0.000 

0.000 

0.000 

-2.000 

-3-000 

0.000 

-3-000 

ga  def 

mod  test 

cases 

ga  prep 

trouble 

reports 

ga  system  software  test 

ga  doc 

test  results  pd  conduct  req  review 

ga  hardware  testing 

ga  software  module  test 

ga  anal 

trouble 

rpts 

clusterl 

0.000 

19.000 

2it  .000 

39-000 

7-000 

1.000 

7-000 

0.000 

cluster7 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

cluster  lit 

1.000 

-6-000 

0.000 

-1.000 

-6-000 

-it.  000 

0.000 

it- 000 

pd 

attend 

walkthroughs 

pd  conduct  design 

review  pd  conduct  walkthroughs 

pd  system  analysis 

pd  attend  design 

review 

pd  attend  req  review 

pd  design 

pd  code 

cluster  1 

0.000 

0.000 

43.000 

19-000 

30.000 

58-000 

9-000 

15-000 

cluster7 

-5-000 

1.000 

0.000 

-3-000 

-1.000 

0.000 

0.000 

-3.000 

cluster  14 

3-000 

0.000 

-8-000 

0.000 

0.000 

-7.000 

0.000 

0.000 

pd  technical  management 

pd  quality  assurance 

pd  formulating 

strategy 

pd  configuration 

mngmnt 

pd  other 

development 

pd  formulation  of 

policy 

pd  program  management 

pd  monitoring  contracts 

c  1  uster 1 

-2.000 

0.000 

-1.000 

-2.000 

0.000 

-2.000 

-3-000 

0.000 

cluster7 

0.000 

-1.000 

0.000 

0.000 

1.000 

2.000 

0.000 

3.000 

clusterllt 

2.000 

0.000 

it.  000 

0.000 

0.000 

0.000 

1.000 

0.000 
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pd  conduct  support  dr  pa  conduct  sup  waikthru 
pd  support  design  pd  cooe  catch  pd  suo  technical  mgmt 

pd  support  analysis  oc  attend  support  or  pd  attend  sup  walk  thru 


c luster  1  1.000  13.000  0.C00  0.000  15.000  1.000 
duster7  O.CCO  0.000  1.000  C.000  0.0C0  0.000 
c I  us  ter  lu  -1.000  -2.000  -1.000  -2.000  -3. 000  C.000 


0.000  0.000 

0.000  -2.000 

-2 .000  1.000 


pd  sur  r. un'ig  management 
pd  SCC3  part i c i pat i pn 


pd  other  support 


pd  sup  program  mgmt 

pa  sup  monitor  contracts 

pd  sup  formuiate  sc' icy 

pc 

suo 

cua 1 ’ tv  assurance 

clusterl  -1.0C0  -l.COJ 

- 1 . jCO 

0.300  -3.000  -4.000  -1. 

000 

cluster7  0.000  0.000 

c.occ 

c.:o 

13  0.000  O.CCO  5. 

000 

clusterl  4  1.000  2.000 

0.00c 

C.00 

>0  0.000  0.000  0. 

000 

Categories  with  High  Posit 

i  ve 

Cat 

egor i ns  with  High  Mega 

t  i  ve 

Residuals  in  Ran*  Order 

Residuals  in  Rank  Order 

Cluster 

1 

pd 

conduct  walkthroughs 

1.000 

ga 

program  r* anagement 

1.000 

pd 

code  patch 

1.CC0 

ga 

sales  rarest  i  r.g 

1.000 

pd 

conduct  sup  walk  thru 

i.oca 

gz 

cont-act  negotiation 

1  .000 

s  -  :•  ?.  2  r  *■  d  e  =  ■  *  r 

•  ~  ~  ~ 

-  - 

r  ~  "  .-3  1  ' 

•  r  fs 

ga 

func  module  design 

1.000 

ca 

formulating  strategy 

1.000 

S3 

def  glob  data  strucs 

i  .000 

ga 

preca'ing  budgets 

l.OCO 

S3 

def  sufasys  interface 

1.000 

gs 

technical  management 

1.000 

ga 

def  stuff  for  own  use 

1.000 

ga 

interv  personnel 

1.000 

ga 

cod i ng 

1 .000 

ga 

preparing  schedules 

l.COO 

ga 

debug  or  modifying 

1.000 

ga 

prep  mgmt  info  rpts 

1  OCf 

ga 

prep  sys  rqt  docs 

1.000 

ga 

prep  fid  eng  rpts 

i-OOO 

pd 

supocrt  analysis 

l.OCO 

ga 

other  admir  tasks 

i.000 

Sa 

prep  vers  descr  r.nis 

!  .000 

53 

tech  advice  to  CCS 

1.000 

ga 

prep  user  mr v  .Is 

1.000 

ga 

1713  *nt  conflg  procs 

l.COO 

ga 

document • ng  cede 

1 .000 

ga 

i  i fcrary  control 

1.000 

ga 

defining  test  cases 

1.000 

95 

qua  1 i ty  assurance 

1.000 

ga 

prep  test  drivers 

l.COO 

pd 

other  support 

1.000 

ga 

prep  hast  plans 

2.000 

ga 

prep  temp  eng  rpt 

1.000 

system  software  test 

« 

4  •  V  S/U 

ga 

orep  techn i cal  rpts 

1 .000 

ga 

-if  mod  test  cases 

l.COO 

S0C5  oa- t i c i pa t i on 

1.000 

ga 

software  msduie  test 

l.COO 

?cl 

sup  program  mgmt 

1.000 

ga 

doc  ‘.’.st  results 

1.000 

pd 

rup  formulate  policy 

l.OCO 

ga 

prep  .  tub's  reports 

l.COO 

pd 

formulation  0:  policy 

1.000 

ga 

anal  trouble  -mts 

i.riJC 

pa 

qua 1 i ty  assurance 

1.000 

PC 

attend  walktnroi.,  .•> 

pa 

program  management 

1.000 

pd 

design 

1 .  coo 

pd 

technical  management 

1. 000 

pd 

conduct  design  review 

1.000 

ga 

updat  training  man 

1.000 

pd 

attend  design  review 

1  .cco 

oti 

monitoring  contracts 

1.000 

Pd 

cede 

1.000 

pc 

sup  monitor  contracts 

1.000 

cd 

attend  supoo-c  cr 

1 . 500 

pc 

sup  auaiity  assurance 

1.000 

pd 

attend  sup  waikthru 

,  zr^rs 

•  V** 

5  - 

.;-i3  version  audits 

1.500 
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pd  formulating  strategy  1.500 
ga  prep  redlined  docs  1.500 
ga  func  system  design  1.500 
ga  being  trained  1.500 
ga  reviewing  tech  work  2.000 
ga  teaching  2.000 
pd  sup  technical  mgmt  2.000 
pd  attend  req  review  2.000 
pd  conduct  support  dr  2.000 
pd  sup  config  management  2.000 


Cluster 


pd  other  support  1.000 
ga  prep  technical  rpts  1.000 
ga  prep  temp  eng  rpt  1.000 
ga  updat  training  man  1.000 
pd  system  analysis  1.000 
ga  tech  advice  to  CCB  1.000 
pd  conduct  support  dr  1.000 
pd  other  development  1.000 
pd  quality  assurance  1.000 
pd  configuration  mngmnt  1.C0C 
ga  other  admin  tasks  1.000 
ga  teaching  1.000 
pd  program  management  1-500 
ga  preparing  budgets  1.500 
ga  formulating  strategy  1.500 
ga  func  system  design  1.500 
ga  formulating  policy  1.500 
pd  sup  quality  assurance  1.500 
ga  sales  marketing  1.500 
ga  quality  assurance  1.500 
ga  being  trained  1.500 
ga  prep  mgmt  info  rpts  1.500 
pd  sup  monitor  contracts  1.500 
ga  maint  config  procs  1.500 
pd  SCC9  participation  1.500 
pd  attend  sup  walkthru  1.500 
pd  attend  support  dr  1.500 
ga  def  subsys  interface  2.000 
ga  debug  or  modifying  2.000 
ga  documenting  code  2.000 
ga  prep  test  plans  2.000 
ga  software  moduie  test  2.000 
ga  doc  test  results  2.000 
ga  prep  trouble  reports  2.000 
ga  def  stuff  for  own  use  2.000 
pd  design  2.000 
pd  code  2.000 
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pd  configuration  mngmnt  1.500 
ga  updat  MIL  STD  specs  1.500 
pd  system  analysis  1.500 
pd  other  development  1.500 
ga  reading  tech  pubs  1.500 
ga  hardware  testing  1.500 
pd  conduct  req  review  1.500 
pd  conduct  support  dr  2.000 
pd  sup  technical  mgmt  2.000 
ga  teaching  2.000 
ga  reviewing  tech  work  2.000 
pd  sup  config  management  2.000 
pd  attend  req  review  2.000 

7 

ga  prep  sys  rqt  docs  1.000 
pd  attend  req  review  1.000 
pd  formulating  strategy  1.000 
pd  sup  technics!  mgmt  1.000 
pc  conduct  design  review  1.000 
ga  def  glob  data  strucs  1.000 
ga  prep  redlined  docs  1.000 
pd  attend  design  review  1.000 
ga  reviewing  tech  work  1.000 
pd  attend  walkthroughs  1.000 
ga  prep  version  audits  1-500 
pd  conduct  walkthroughs  1.500 
ga  def  mod  test  cases  1.500 
ga  prep  user  manuals  1.500 
pd  conduct  req  review  1.500 
ga  prep  vers  descr  mnls  1.500 
ga  anal  trouble  rpts  1.500 
ga  reading  tech  pubs  1.500 
ga  prep  test  drivers  1.500 
pd  conduct  sup  walkthru  1.500 
ga  updat  MIL  STD  specs  1.500 
ga  hardware  testing  1.500 
ga  debug  or  modifying  2.000 
ga  def  stuff  for  own  use  2.000 
ga  def  subsys  interface  2.000 
ga  prep  test  plans  2.000 
ga  library  control  2.000 
ga  prep  fid  eng  rpts  2.000 
ga  func  module  design  2.000 
ga  technical  management  2.000 
ga  contract  negotiation  2.000 
ga  program  management  2.000 
ga  doc  test  results  2.000 
pd  design  2.000 
ga  prep  trouble  reports  2.000 
ga  software  module  test  2.000 
ga  system  software  test  2.000 
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9* 

1  i brary  control 

2.000 

Pd 

formulation  of  policy 

2.000 

ga 

prep  fid  erg  rpts 

2.000 

ga 

preparing  schedules 

2.000 

pd 

technical  management 

2.000 

Pd 

monitoring  contracts 

2. COO 

ga 

interv  personnel 

2.000 

pd 

support  analysis 

2.000 

Pd 

support  design 

2.000 

ga 

technical  management 

2.000 

ga 

system  software  test 

2.000 

Pd 

code  patch 

2.000 

ga 

def i ni ng  test  cases 

2.000 

Pd 

sup  formulate  policy 

2 . 000 

pd 

sup  program  ngrat 

2.  COO 

ga 

cod i ng 

2.000 

pd 

sup  config  management 

2.000 

ga 

contract  negotiation 

2.000 

ga 

func  module  design 

2.000 

ga 

program  management 

2.000 

C 1  us 

ga 

program  management 

1.000 

Pd 

conduct  req  review 

1.000 

gs 

contract  negotiation 

1.000 

ga 

reviewing  tech  work 

1.000 

ga 

reading  tech  pubs 

1.000 

pd 

sup  program  mgmt 

1.000 

ga 

technical  management 

1.000 

ga 

interv  personnel 

1.000 

ga 

preparing  schedules 

1.000 

pd 

sup  formulate  policy 

1 .000 

ga 

prep  fid  eng  rpt* 

1.000 

Pd 

sup  technical  mgmt 

1.000 

Pd 

monitoring  '•c.’ tracts 

1.000 

ga 

updat  MIL  ST'  specs 

1.000 

ga 

1  ibrary  control 

3.000 

ga 

prep  version  audits 

1.000 

pd 

technical  management 

1.000 

cd 

formulation  of  policy 

1 .000 

P- 

attend  red  review 

1.000 

ga 

hardware  testing 

1.000 

Pd 

formulating  strategy 

1.500 

ga 

formu  .ting  strategy 

1.500 

ga 

formulating  pc'  icy 

1.500 

ga 

sales  marketing 

1.50'.. 

ga 

maint  config  procs 

1 . 500 

ga 

prep  red  1 i ned  docs 

1.500 

od 

program  management 

1.500 

pd 

sup  monitor  contracts 

1.500 

od 

sup  quality  assurance 

1.500 

SC23  participation 

1.500 

pd 

code 

2.000 

ga 

defining  test  cases 

2.000 

ga 

documenting  code 

2.000 

Pd 

formulation  of  policy 

2.000 

ga 

cod i ng 

2.000 

pd 

technical  management 

2.000 

pd 

monitoring  contracts 

2.000 

p<? 

support  analysis 

2.000 

pd 

support  design 

2.000 

pd 

code  patch 

2.000 

Sa 

preparing  schedules 

2.000 

ga 

interv  personnel 

2.000 

pd 

sup  formulate  policy 

2.000 

sc 

sue  program  mgmt 

2.000 

sd 

sup  config  management 

2.000 

H 


ga  doc  test  results  1.000 
ga  software  nodule  test  1.000 
pc  attend  sup  *.s!kthru  I.OCC 
pa  code  1.000 
ga  teaching  1.000 
pd  code  patch  1.000 
ga  being  trained  1.000 
g3  func  system  design  1.000 
ga  func  module  design  1.000 
pd  attend  support  dr  1.000 
ga  def  subsys  interface  1.000 
ga  def  stuff  for  own  use  1.000 
ga  coding  1.000 
ga  debug  or  modifying  1.000 
pd  conduct  support  dr  1.000 
pd  support  analysis  1.000 
pd  support  design  1.000 
ga  documenting  code  1.000 
ga  defining  test  cases  1.000 
pd  design  1.000 
ga  prep  test  plans  1.000 
ga  system  software  test  1.000 
ga  prep  trouble  reports  1.000 
pd  configuration  mngmnt  1.500 
pd  other  development  1.500 
ga  def  mod  test  cases  1.500 
ga  anal  trouble  rpts  1.500 
pd  system  analysis  1.500 
ga  prep  test  drivers  1.500 
ga  prep  user  manua’s  1.500 
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ga  preparing  budgets  1.500 
ga  prep  mgmt  info  rpts  1.500 
ga  quality  assurance  1.500 
ga  def  glob  data  strucs  2.000 
pd  attend  design  review  2.000 
ga  prep  sys  rqt  docs  2.000 
pd  quality  assurance  2.000 
ga  tech  advice  to  CCB  2.000 
ga  other  admin  tasks  2.000 
ga  prep  temp  eng  rpt  2.000 
ga  prep  technical  rpts  2.000 
pd  attend  walkthroughs  2.000 
pd  sup  config  management  2.000 
pd  conduct  design  review  2.00C 
ga  updat  training  man  2.000 
pd  other  support  2.000 


ga  prep  vers  descr  mnls  1.500 
pd  conduct  sup  walkthru  1.500 
pd  conduct  walkthroughs  1.500 
ga  other  admin  tasks  2.000 
ga  tech  advice  to  CCB  2.000 
pd  quality  assurance  2.000 
pd  sup  config  management  2.000 
pd  attend  design  review  2.000 
pd  conduct  design  review  2.000 
ga  prep  sys  rqt  docs  2.000 
ga  def  glob  data  strucs  2.000 
ga  updat  training  man  2.000 
ga  prep  technical  rpts  2.000 
ga  prep  temp  eng  rpt  2.000 
pd  attend  walkthroughs  2.000 
pd  other  support  2.000 


Cluster  1  of  the  development  employees  is  not  strong  on  much  except  training  and 
is  weak  on  technical  management  and  admi ni » irat i >/e  activities  and  duties.  Clus¬ 
ter  3  is  strong  on  support  design  and  coding  and  weak  on  document  and  report 
preparation.  These  would  be  support  designers.  Cluster  k  is  strong  on  design, 
coding,  and  software  work,  weak  on  administrative  and  management  activities  and 
sales.  These  would  be  programmer  analysts.  Cluster  7  is  strong  on  budgets, 
reports,  and  various  management  activites.  It  is  weak  on  design  and  coding. 
These  would  be  lower-level  administrators.  Finally,  cluster  153  is  strong  on 
technical  management,  contracts,  administration,  and  sales  and  weak  on  software 
work.  These  would  be  lower-level  technical  management. 

Support  cluster  1  is  strong  on  walkthroughs,  analysis,  testing,  and  coding; 
it  is  weak  on  management,  sales,  and  technical  management.  These  would  be  the 
maintenance/testing  people.  Cluster  ^  is  strong  on  most  support  duties  and 
quality  assurance  and  weak  on  reviews,  walkthroughs,  and  testing.  These  would 
be  general  support  personnel.  Finally,  cluster  lk  is  strong  on  management  and 
administrative  activities  but  weak  on  software  related  duties  and  activities. 
These  would  be  low-level  support  administrators. 
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Conclusions 

Two  general  conclusions  come  out  of  the  single  variable  descriptions  and 
the  two  variable  tables.  First,  there  is  a  general  tendency  in  the  sample  to¬ 
ward  development  as  opposed  to  support.  Secondly,  people  who  have  been  in  the 
field  longer  tend  to  know  more  and  tend  to  be  in  higher  positions.  The  first 
conclusion  is  moderately  interesting,  the  second  hardly  surprising. 

Experience  with  Ada  seems  so  minimal  at  the  current  time  that  not  much  can 
be  said  about  the  influences  of  the  various  methods  of  training  or  exposure. 
Design  of  Ada  training  programs  should  be  targeted  at  the  appropriate  lack  of 
knowledge  in  the  industry  as  currently  structured. 

The  classification  itself  makes  sense  when  compared  to  various  parts  of  the 
data.  But  the  classification  does  little  more  than  restate  the  obvious  in  that 
it  says  people  should  be  classified  on  the  basis  cf  whether  they  are  in  support 
or  development  or  whether  they  are  managers,  administrators,  or  others.  The 
methods  used  might  aliow  a  more  complete  specification  based  on  particular  job 
outputs,  general  activities,  or  principal  duties.  This  specificity  is  somewhat 
counterintuitive  given  the  clustering  level;  that  is,  it  doesn't  really  make 
sense  to  talk  sbcjt  the  cluster  categories  in  anything  but  the  most  general 
terms  (such  as  support  management) . 

Lastly,  it  might  well  be  that  either  the  people  responding  to  the  survey  or 
the  survey  analyst  or  both  have  used  the  inherent  classifications  (support,  de¬ 
velopment,  design  methodologies,  programming  concepts,  and  so  on)  to  interpret 
the  survey.  This  might  explain  the  tendency  to  see  things  tending  to  divide  up 
that  way.  On  the  other  hand,  the  categories  between  these  concepts  are  numerous 
enough  and  the  variation  extensive  enough  to  believe  that  specific  conclusions 
are  relatively  free  from  interpretive  bias.  But  at  the  vaguest  levels  of 
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generalization — particular 1 y  the  interpretation  of  the  cluster  categor ies — the 
reduction  in  content  might  well  be  sufficient  to  allow  the  inherent  categories 
to  reemerge,  rendering  the  end  product  circular.  This  circularity  might  have 
been  avoided  by  a  survey  format  that  imposed  fewer  assumptions  about  the  world; 
on  the  other  hand,  the  assumptions  that  were  present  are  not  unreasonable.  But 
the  reader  should  bear  in  mind  the  underlying  bias  due  to  the  survey  format  when 
interpreting  the  results. 
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Appendix  1 


Datasets,  Attributes,  and  Possible  Values 


Codes 


Attribute 

Dataset  Ada  training 
Ada  training 

id 

Dataset  conference  role 
conference  role 
id 

Dataset  experience  area 
experience  area 

id 

Dataset  general  activities 
activi ty 


other 

seminar 

in  house  courss 
videotape 


other 

speaker 


other 

educational 
mi  1 i tary 


program  management 
prep  test  drivers 
documenting  code 
prep  version  descr  mnls 
updating  MIL  STD  specs 
debugging  or  modifying 
def  stuff  for  own  use 
def  global  data  strucs 
func  system  design 
updating  training  manual 
reviewing  tech  work 
prep  technical  rpts 
quality  assurance 
I ibrary  control 
tech  advice  to  CC8 
preparing  fid  eng  rpts 
preparing  schedules 
technical  management 
formulating  strategy 


informal  training 
programmed  learning 
college  course 


attendee 

organizer 


statistical 

embedded  computer  sys 

commercial 


prep  test  plans 
defining  test  cases 
prep  user  manuals 
prep  red  lined  docs 
prep  sys  rqt  docs 
coding 

def  subsystem  interface 
func  module  design 
being  trained 
teach i ng 

reading  tech  pubs 
prep  temp  eng  change  rpt 
prep  version  audi ts 
maint  config  procs 
other  admin  tasks 
preparing  mgmt  info  rpts 
interviewing  personnel 
preparing  budgets 
formulating  pol icy 
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contract  negotiation 

sales  marketing 

hardware  testing 

system  software  test 

defining  mod  test  cases 

software  module  testing 

documenting  test  results 

prep  trouble  reports 

i  rf 

analyzing  trouble  rpts 

i  a 

importance 

pr imary 

secondary 

marginal 

Dataset  job 

history 

Ada  i nvo 

lvement 

Ada  not  known 

heard  of 

Ada 

had  orientation  to  Ada 

Ada  trai 

ni  ng 

other 

company 

company  ten 

company 

nine 

company  eight 

company 

seven 

company  six 

company 

five 

company  four 

company 

three 

company  two 

company 

one 

conference  attendance 

yes 

no 

date  of  survey 
id 


job  level 

high  level  mgmt 

middle  mgmt 

job  title 

technical 

entry  level 

published  or  presented 
rank 

yes 

no 

sector 

pub  1  i  c 

private 

technical  reading  extent 

regularly 

occasional ly 

only  as  my  job  demands 
other 

never 

technical  societies 

no 

yes 

years  of  involvement 

less  than  two  years 

two  to  five  years 

five  to  ten  years 

over  ten  years 

years  worked  development 

less  than  a  year 

one  to  three  years 

three  to  five  years 

over  five  years 

years  worked  support 

less  than  a  year 

one  to  three  years 

three  to  five  years 

over  five  years 

Dataset  job  output 
id 

job  output 


STR  analyses 
red  1 i ned  documents t i on 
support  test  drivers 
updated  MIL  STD  spec 
maintain  config  procs 
updated  user  manuals 
automated  build  systems 
version  descrip  docs 
field  engineering  report 


temp  ECPs 

support  test  plans 
tech  advice  to  CCB 
i ibrary  control 
updated  training  manuals 
STRs 

management  info  reports 
version  audi ts 
support  other 
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development  other 
interview  sheets 
mi lestone  charts 
cost  data 
integration  plans 
design  specs 
prog  design  language 
test  drivers 
hard  soft  tradeoff  eval 


Dataset  methodologies 
id 

knowledge 

methodology 


used  frequently 

know  concept 

other  Ada  concepts 

Ada  information  hiding 

Ada  elaboration 

Ada  generic  prog  units 

Ada  separate  compilation 

Ada  entries 

Ada  task  types 

Ada  visibility 

Ada  scope 

Ada  packages 

Ada  access  types 

Ada  aggregates 

Ada  rec  types  discrim 

Ada  fixed  pt  types 

Ada  real  types 

Ada  subtypes 

Ada  enumeration  types 

version  number 

loop  invariants 

data  abstraction 

strong  typing 

recurs  ion 

i teration 

name  visibility 

data  encapsulation 

other  prog  constructs 

exception  handlers 

goto  statements 

clusters  modules  package 

functions 

exit  statements 

if  then  else  statements 

blocks 

formal  actual  params 
global  variables 
variant  records 
ranges 


correspondence 
status  reports 
analysis  reports 
management  plans 
test  plans 
requirements  specs 
code 

data  flow  diagrams 


used  moderately 
heard  of 

Ada  mutual  recursion 
Ada  context  spec 
Ada  instantiation 
Ada  exceptions 
Ada  entry  f ami  I i es 
Ada  rendezvous 
Ada  tasking 
Ada  short  circuiting 
Ada  private  types 
Ada  over  1 oad i ng 
Ada  al locators 
Ada  s 1 i ces 
Ada  record  types 
Ada  float  point  types 
Ada  derived  types 
Ada  user  defined  types 
other  prog  concepts 
parameter  binding 
gener i cs 
type  conversion 
concurrency 

conditional  statements 

static  dynamic  nesting 

name  scoping 

importing  exporting  name 

task  coroutines 

comments 

stubs 

return  statements 
procedures 
loop  for  while  unti 1 
case  statements 
reserved  words 
local  variables 
object  type  dels 
records 

typed  pointers 
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pointers 

fixed  point  types 
enumeration  types 
SADT 
HIPC 

Structured  Design 
N  S  Chapin  Chart 
Program  Design  language 
Structured  Walkthroughs 
Top  Down  Testing 
Bachman  Diagramming 
Data  Abstraction 


Dataset  principal  duties 

id 

principal  duties  other  support 

sup  quality  assurance 
SCCB  participation 
sup  policy  formulation 
attend  sup  walkthrough 
code  patch 
conduct  support  dr 
support  analysis 
monitoring  contracts 
configuration  management 
technical  management 
formulation  of  policy 
conduct  walkthroughs 
attend  design  review 
design 

attend  req  review 


Dataset  programming  languages 
id 

language  Other 

PPL 

SAS 

ECL 

LISP 

FORTH 

XPL 

MODULA 

ALGOL 

PASCAL 

ASSEMBLER 

FORTRAN 

CMS  2 

proficiency  first 


user  defined  types 
floating  point  types 
PSL  PLA 
SREM 

Jackson  Design 
Warnier  Orr  Design 
Beamson  Tables 
Structured  Programming 
Top  Down  Design 
Bottom  Up  Design 
Entity  Diagrams 
other  methodology 


sup  monitoring  contracts 
sup  config  management 
sup  program  management 
sup  technical  management 
conduct  sup  walkthrough 
attend  support  dr 
support  design 
other  development 
qual i ty  assurance 
program  management 
formulation  of  strategy 
attend  walkthroughs 
code 

conduct  design  review 
system  analysis 
conduct  req  review 


APL 

PROTEGE 

GPSS 

SNOBOL 

Ada 

MMP 

SIMULA 

RATFOR  WATFOR  WATFIV 

BASIC 

PL  I 

COBOL 

C 

JOVIAL 

second 
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Appendix  3 
Cluster  Trees 

Cluster  Tree  Based  on  General 
Activities,  Principal  Duties,  and  Job  Outputs 
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Cluster  Tree  Based  on  Principal  Duties 
and  Primary  General  Activities  for  Development  Employees 
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Job  Titles  for  the  Development  Clusters 


Respondent  Job  Title  Position  in  Hi 


cluster  1 

1001 

Consul tant 

techni ca 

3062 

* 

ft 

3025 

Senior  Engineer 

techni ca 

4007 

Staff  Consultant 

technica 

3024 

R&D  Engineer 

technica 

4005 

Programmer  Analyst 

technica 

4063 

ft 

* 

3120 

Programmer 

technica 

3085 

Senior  Engineer 

technica 
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. «  *-»*»-*■  w  -* 


I 


erarchy 


cluster  153 


7006 

Computer 

Spec i a  1 i st 

techn i ca  1 

7005 

Computer 

Special ist 

techni cal 

7004 

Computer 

Spec i a  1 ist 

technical 

6005 

* 

A 

6007 

Computer 

Sc i ent i st 

technical 
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cluster3 


3078  R60  Engineer 

1082  Senior  Software  Engineer 
1*01*5  Senior  Analyst 
5031  * 

501*8  * 

5071*  Programmer 
5060  * 

3077  Senior  Software  Engineer 

3113  Software  Engineer 

1*058  * 

1*023  Senior  System  Analyst 

3114  Software  R&D  Engineer 
3080  Senior  Engineer 

2011*  Supervising  System  Analyst 
1012  Software  Design  Specialist 
3086  * 

1*015  Senior  Programmer  Analyst 


technical 

technical 

technical 

* 

* 

technical 

* 

technical 

technical 

* 

technical 
technical 
techni cal 
middlejngmt 
technical 
A 

techni cal 
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c  1  usterl* 


2007 

Senior  Scientific  Programmer 

technical 

2016 

Scientific  Programmer 

technical 

1080 

Senior  Software  Engineer 

technical 

2018 

Principle  Scientific  Programmer 

technical 

2020 

Principle  Scientific  Programmer 

technical 

1094 

Software  Engineer 

technical 

1074 

Software  Design  Specialist 

technical 

7010 

Computer  Specialist 

technics  1 

3C15 

Engineer 

technical 

3018 

Senior  Engineer 

technical 

1016 

Software  Engineer 

technical 

1090 

System  Engineering  Specialist 

technical 

3001 

Junior  Prograriuner 

entry_l ev 

3028 

Digital  Signal  Processing 

technical 

3030 

ft 

* 

3031 

R6D  Engineer 

technics  1 

3032 

Eng i neer 

technical 

5067 

* 

* 

3049 

Junior  Programmer 

entry_l ev 

3051 

Advanced  Development  Engineer 

technics  1 

3052 

Engineering  Specialist 

technical 

3054 

* 

* 

3042 

R&D  Engineer 

technical 

3063 

Programmer  Analyst 

technical 

3065 

Programmer 

technical 

3068 

RED  Engineer 

technical 

3069 

Senior  Engineer 

technical 

3072 

Software  Engineer 

technical 

3074 

Engineer 

technical 

3011 

Software  RED  Engineer 

technical 

3010 

Communications  Software 

technical 

3007 

Advanced  RED  Engineer 

technical 

3006 

Supervisor 

m i dd 1 e_mg 

3005 

Senior  Software  Engineer 

technical 

3087 

RED  Engineer 

technical 

3089 

Researcn  Engineer 

technical 

3091 

Software  Engineer 

technical 

3093 

Engineering  Specialist 

technical 

2011 

Data  Processing  Consultant 

technical 

3109 

RED  Engineer 

technical 

5**11 

Senior  Engineer 

technical 

2002 

Programmer 

technical 

2001 

Senior  Programmer 

technical 

1100 

engineer 

technical 

3H7 

Engineering  Specialist 

technical 

3119 

RED  Engine*, 

technical 

1084 

Software  Design  Specialist 

techni ca 1 

3122 

* 

* 

1075 

Software  Design  Specialist 

technics  1 

4004 

Programmer  Analyst 

technical 

1072 

it 

it 

4039 

Consultant 

technical 
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1029 

4008 

1014 

4016 

1004 

4024 

4027 

4028 
4032 

4034 

4035 

4036 
8004 
7011 
4043 
4002 
4048 
4051 
4056 
3112 
4060 
4062 
3094 
4065 
4067 
1091 

4069 

4070 
4073 

4075 

4076 
5001 
5002 

5004 

5005 

5007 

5008 
5011 
5013 
5016 
5021 
5024 
5026 
3023 
5032 

5036 

5037 

5038 
5043 
5045 
5047 
3004 
5049 
5052 


Software  Design  Specialist 
* 

Senior  Software  Engineer 

Senior  Programmer  Analyst 

Engineering  Software  Supervisor 

Programmer  Analyst 

Senior  GS  Analyst 

Principle  Programmer  Analyst 

Analyst 

Government  Program  Analyst 
Government  Program  Analyst 
Principle  Programmer  Analyst 
Team  Leader 
Computer  Specialist 
ft 

Programmer 

Principle  Programmer  Analyst 

Firmware  Design  Engineer 

System  Analyst 

Consultant 

Principle  Engineer 

Senior  Programmer  Analyst 

Software  Engineer 

Programmer 

Programmer  Analyst 

System  Design  Specialist 

Associate  Programmer  Analyst 

Programmer 

Programmer  Analyst 

Senior  Engineer 

Quality  Assurance  Engineer 

ft 

* 

* 

* 

ft 

Diagnostic  Software 
ft 
* 
ft 
ft 
ft 
ft 
ft 
ft 
ft 
ft 
ft 
ft 
ft 
ft 

Research  Engineer 
* 

* 


technical 

ft 

technical 

technical 

m i dd 1 e_mgmt 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

middle_mgmt 

technical 

ft 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

technical 

entryjevel 

technical 

technical 

technical 

technical 

ft 

* 

ft 

ft 

ft 

technical 

* 

ft 

ft 

ft 

ft 

* 

ft 

ft 

* 

* 

* 

* 

* 

* 

technical 

ft 

ft 
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5057 

ft 

ft 

2013 

Principle  Scientific  Programmer 

technical 

5063 

* 

* 

5080 

* 

* 

5068 

* 

* 

5069 

* 

* 

5070 

* 

it 

5071 

it 

ft 

5072 

* 

* 

9005 

Electrical  Engineer 

technical 

5078 

it 

* 

1052 

Senior  Engineering  Specialist 

technical 

6004 

Project  Leader 

m i dd 1 e_mgmt 

1079 

Senior  Software  Engineer 

technical 

1078 

Senior  Engineer 

technical 

6009 

Electronic  Technician 

entry_level 

6011 

Electrical  Engineer 

technical 

7001 

Computer  Specialist 

technical 

1064  *  * 

1060  Software  Engineer  technical 

9004  Electrical  Engineer  technical 

9006  Electrical  Engineer  technical 


cluster7 

6010  Electrical  Engineer 
2009  Project  Supervisor 
1031  Software  Design  Specialist 
4042  Principle  Systems  Analyst 
4006  Senior  Applications  Analyst 
4068  Consultant 


technical 

m i dd 1 e_mgmt 

technical 

technical 

technical 

technical 


Job  Titles  for  the  Support  Clusters 


Respondent  Job  Title  Position  in  Hierarchy 

cluster  1 


1007 

Senior  Software  Engineer 

technical 

1010 

Software  Engineer 

technical 

1015 

Software  Engineer 

technical 

1017 

Software  Engineer 

technical 

1026 

Software  Design  Specialist 

technical 

1040 

Software  Design  Specialist 

technical 

5009 

* 

ft 

5010 

X 

* 

1044 

Software  Engineer 

technical 

4009 

Consul  tant 

technical 

6008 

Computer  Scientist 

technical 

1048 

Software  Engineering  Specie 

si  ist  technical 

1049 

Software  Design  Specialist 

technical 

5077 

* 

ft 

5075 

* 

ft 

1055 

* 

ft 

5073 

* 

* 

1058 

Associate  Engineer 

entrywleve 

3104 

Software  Engineer 

technical 

5065 

a 

* 

1077 

Electrical  Engineer 

technical 

5064 

* 

ft 

5062 

* 

* 

2003 

Scientific  Programmer 

technical 

5056 

* 

* 

5044 

Programmer 

technical 

3003 

Software  Engineer 

technical 

5042 

* 

* 

3012 

Senior  Engineer 

technical 

3014 

Softwsri  Engineer 

technical 

3020 

P.&0  Engineer 

technical 

3027 

Engineering  Specialist 

technical 

3033 

Senior  Engineer 

technical 

3035 

Senior  Engineer 

technical 

5041 

Programmer 

technical 

3037 

Software  Engineer 

technical 

5040 

ft 

* 

5033 

* 

ft 

3043 

Senior  Engineer 

technical 

5028 

* 

* 

!  3045 

ft 

ft 

1  3046 

Software  Engineer 

technical 

3047 

ft 

ft 

3043 

Software  Engineer 

technical 

3050 

RSO  Engineer 

technical 

3053 

Senior  Software  Engineer 

technical 

3059 

Senior  Engineer 

technical 
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3064 

Software  Engineer 

technical 

3066 

Senior  Software  Engineer 

technical 

3067 

Software  Engineer 

technical 

5027 

* 

* 

3073 

Software  Engineer 

technical 

3075 

Software  Engineer 

technical 

3076 

* 

A 

5025 

* 

* 

3084 

Software  Engineer 

technical 

5022 

* 

A 

3092 

Senior  Engineer 

technical 

3099 

Advanced  Research  Engineer 

technical 

4040 

System  Programming  Analyst 

technical 

3106 

* 

A 

3107 

Engineer 

technical 

3110 

Senior  Software  Engineer 

technical 

3115 

Software  Engineer 

technical 

3H6 

Engineer 

technical 

3H8 

Engineer 

technical 

3121 

Software  Engineer 

technical 

5020 

* 

A 

5019 

a 

A 

4071 

Programmer 

technical 

4059 

Programmer  Analyst 

technical 

4022 

Programmer 

technical 

4031 

Principle  Programmer 

technical 

4053 

Programmer  Analyst 

technical 

cluster U 


7003 

Programmer 

technical 

7007 

Computer  Specialist 

technical 

7013 

Computer  Specialist 

technical 

1065 

Engineering  Manager 

high_leve)_mgmt 

1*021 

Associate  Applications 

Ana  1 yst 

entry_level 

4064 

Manager,  Software  Development 

middle_mgmt 

4054 

Programmer  Analyst 

technical 

7015 

Computer  Specialist 

techni cal 

70U 

Computer  Specialist 

technical 

5066 

* 

A 

1053 

Software  System  Engineer 

technical 

1050 

Software  Design  Special 

list 

technical 

3071 

Senior  System  Engineer 

technical 
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4057 

Programmer 

technical 

4019 

Analyst 

technical 

4074 

* 

* 

4018 

Electrical  Engineer 

technical 

4012 

Principle  Programmer  Analyst 

technical 

4001 

System  Engineer 

technical 

3088 

Senior  Engineering  Specialist 

technical 

3081 

Software  Engineer 

technical 

5015 

* 

* 

5014 

* 

* 

4013 

Software  System  Programmer 

technical 

5039 

* 

* 

5006 

* 

* 

3036 

* 

* 

3008 

Programming  Aide 

entryjeve 

2023 

Associate  Scientific  Programmer 

entryjeve 

5046 

* 

~  * 

5050 

A 

* 

5055 

* 

* 

2017 

Senior  System  Analyst 

technical 

5059 

* 

* 

1096 

Software  Design  Specialist 

technical 

1087 

Software  Engineering  Specialist 

technical 

1076 

Software  Engineer 

technical 

3038 

Software  Engineer 

technical 

1057 

Principle  Engineer 

technical 

3039 

* 

* 

3044 

Software  Engineer 

technical 

5079 

* 

* 

6003 

General  Engineer 

technical 

6006 

Software  Quality  Assurance 

technical 

1046 

Software  Engineer 

technical 

7002 

Computer  Specialist 

technical 

1045 

Software  Engineer 

technical 

1043 

Senior  Oynamics  Engineer 

technical 

7012 

Computer  Specialist 

technical 

1041 

Software  Design  Specialist 

technical 

5003 

* 

* 

4077 

Engineer 

technical 

8001 

Computer  Systems  Analyst 

technical 

8002 

Software  System  Analsyt 

technical 

8005 

Computer  Specialist 

technical 

9003 

Mathematician 

technical 
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Support  Clusters 
counts 

years  of  involvement 

five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 

clusterl  13.000  32.000  14.000  14.000  73.000 

ciuster7  7.000  10.000  8.000  18.000  43.000 

clusterl4  2.000  2.000  2.000  7.000  13.000 

22.000  44.000  24.000  39.000  129.000 


counts  row  pet 


years  of  involvement 


five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 


clusterl 
cluster 7 
clusterl4 


17.808  43.836 


1C • ^ / 7 

15.385 

17.054 


15.385 

34.109 


19.178  19.178  100.000 

15. 605  41.860  100.000 

15.385  53.846  100.000 

18.605  30.233  100.000 


counts  column  pet 


years  of  involvement 


five  to  ten  years 
two  to  five  years 

less  than  two  years  over  te 


over  ten  years 


clusterl 

cluster7 

cxuster!4 


59.091  72.727  58.333  35.897  56.589 

31.318  22.727  33.333  46.154  33.333 

9.091  4.545  8.333  17.949  10.078 

100.000  100.000  100.000  100.000  100.000 


counts  table  oct 


years  of  involvement 

five  to  ten  years 
two  to  five  years 

less  than  two  years  over  ten  years 
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clusterl 

cluster7 

cluster!4 


10.078 

5.426 

1.550 

17.054 


24.806 

7.752 

1.550 

34.109 


10.853 

6.202 

1.550 

18.605 


10.853  56.589 

13.953  33.333 

5.426  10.078 

30.233  100.000 


It 
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Development  Clusters 
counts 


years  of  involvement 


five  to  ten  years 


two  to  five  years 


less 

than  two 

years 

over 

ten  years 

clusterl 

1.000 

4.000 

0.000 

4.000 

9.000 

cluster3 

2.000 

7.000 

3.000 

5.000 

17.000 

cluster4 

10.000 

36.000 

29.000 

54.000 

129.000 

cluster7 

0.000 

0.000 

1.000 

5.000 

6.000 

cluster!53 

o.ooc 

0.000 

1.000 

4.000 

5.000 

13.000 

47.000 

34 . 000 

72.000 

166.000 

counts  row  pet 

years  of  involvement 

five  to  ten  years 
two  to  five  years 


less  than  two  years  over  ten  years 


d  cluster 

clusterl 

11.111 

44.444 

0.000 

44.444 

100.000 

cluster3 

11.765 

41.176 

17.647 

29.412 

100.000 

cluster4 

7.752 

27.907 

22.481 

41.860 

100.000 

cluster7 

0.000 

0.000 

16.667 

83.333 

100.000 

clusterl53 

0.000 

0.000 

20.000 

80.000 

100.000 

7.831 

28.313 

20.482 

43.373 

100.000 

counts  column  pet 

years  of  involvement 


five  to  ten  years 
two  to  five  years 


less 

than  two 

years 

over 

ten  years 

d  cluster 
clusterl 

7.692 

8.511 

0.000 

5.556 

5.422 

cluster  1 

15.385 

14.894 

8.824 

6.944 

10.241 

cluster4 

76.923 

76.596 

85.294 

75.000 

77.711 

cluster  7 

0 . 1 00 

0.000 

2.941 

6.944 

3.614 

clusterl53 

0.000 

0.000 

2.941 

5.556 

3.012 

100.000 

100.000 

100.000 

100.000 

100.000 

counts  table  pet 
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years  of  involvement 


qe*.’ 


five  to  ten  years 
two  to  five  years 


less 

than  two 

years 

clusterl 

0.602 

2.410 

cluster 3 

1.205 

4.217 

cluster4 

6.024 

21.687 

cluster7 

0.000 

0.000 

clusterl53 

0.000 

0.000 

7.831 

28.313 

over  ten  years 


0.000 

2.410 

5.422 

1.807 

3.012 

10.241 

17.470 

32.530 

77.711 

0.602 

3.012 

3.614 

0.602 

2.410 

3.012 

20.482 

43.373 

100.000 
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Development  Clusters 


cluster3  cluster7 


clusterl 

cluster4 

cluster!53 

language 

JOVI AL 

2 

3 

25 

0 

1 

31 

CMS  2 

2 

6 

44 

1 

1 

54 

C 

0 

1 

15 

0 

0 

16 

FORTRAN 

8 

15 

123 

6 

5 

157 

COBOL 

£ 

8 

68 

3 

4 

89 

ASSEMBLER 

7 

16 

122 

5 

5 

155 

PL  I 

1 

6 

67 

2 

3 

79 

PASCAL 

5 

13 

64 

3 

1 

86 

BASIC 

7 

10 

82 

4 

3 

106 

ALGOL 

3 

2 

29 

1 

1 

36 

RATFOR  WATFOR  WATFIV 

2 

5 

33 

i 

x 

2 

43 

MODULA 

0 

0 

3 

0 

0 

3 

SIMULA 

0 

1 

3 

0 

0 

4 

XPL 

0 

0 

4 

1 

0 

5 

MMP 

0 

0 

0 

0 

0 

0 

FORTH 

1 

0 

8 

0 

0 

9 

Ada 

1 

10 

28 

2 

1 

42 

LISP 

2 

4 

26 

0 

0 

32 

SNOBOL 

2 

4 

25 

0 

0 

31 

ECL 

0 

0 

0 

1 

0 

1 

GPSS 

1 

2 

15 

0 

1 

19 

SAS 

0 

0 

1 

0 

0 

1 

PROTEGE 

0 

0 

0 

0 

0 

0 

PPL 

0 

0 

0 

0 

0 

0 

APL 

4 

4 

32 

1 

1 

42 

Other 

2 

3 

36 

1 

1 

43 

56 

113 

853 

32 

30 

1084 
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Support  Clusters 


language 

JOVIAL 

CMS_2 

C 

FORTRAN 
COBOL 
ASSEMBLER 
PL  I 

PASCAL 

BASIC 

ALGOL 

RATFOR_WATFOR  WATFIV 

MODULA 

SIMULA 

XPL 

MMP 

FORTH 

Ada 

LISP 

SNOBOL 

ECL 

GPSS 

SAS 

PROTEGE 

PPL 

APL 

Other 


cluster7 

clusterl  clusterl4 


12  6 
21  14 

4  2 

68  40 

31  20 

63  38 

44  17 

41  16 

44  27 

17  4 

21  8 

1  1 

2  0 

2  0 

0  0 

6  4 

11  14 

12  4 

15  6 

1  0 

9  7 

2  2 

1  0 

0  0 

25  12 

13  7 

466  249 


1  19 

2  37 

2  8 

11  119 

6  57 

7  108 

4  65 

4  61 

8  79 

2  23 

2  31 

0  2 

0  2 

0  2 

0  0 

1  11 

3  28 

1  17 

1  22 

0  1 

2  18 

0  4 

0  1 

0  0 

1  38 

6  26 

64  779 


Table  of  Development  Clusters  versus  Methodology  versus  Knowledge 


Cluster : 
clusterl 


knowledge 


methodology 
PSL  PLA 
SADT 
SREM 
HI  PO 

Jackson  Design 
Structured  Design 
Warnier  Orr  Design 
N  S  Chapin  Chart 
Beamson  Tables 
Program  Design  language 
Structured  Programming 
Structured  Walkthroughs 
Top  Down  Design 
Too  Do'.-.t.  Testing 
Bottom  Up  Design 
Bachman  Diagramming 
Entity  Diagrams 
Data  Abstraction 
other  methodology 
enumeration  types 
floating  point  types 
fixed  point  types 
user  defined  types 
pointers 
typed  pointers 
ranges 
records 

variant  records 
object  type  dels 
global  variables 
local  variables 
formal  actual  pa rams 
reserve-  words 
blocks 

case  statements 

if  then  else  statements 

loop  for  while  until 

exit  statements 

procedures 

functions 

return  statements 


used  frequently 
know  concept 

heard  of  used  moderately 


0 

0 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

1 

1 

1 

1 

0 

1 

2 

1 

1 

0 

1 

2 

4 

2 

1 

1 

0 

2 

2 

1 

1 

0 

1 

1 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

2 

0 

0 

1 


2 

1 

0 

4 

4 

X 

0 

1 

0 

0 

2 
0 
0 
1 
3 
1 
0 
0 
0 
0 
0 
1 
2 
1 
0 
2 
1 
0 
2 
3 
0 
0 
0 
1 
0 
1 
1 
1 
1 

1 

« 

0 


0 

0 

0 

0 

0 

8 

0 

0 

0 

6 

9 

8 

6 

4 

3 
0 
0 
1 
1 
2 
6 
6 
6 
9 

4 

5 
8 

4 
3 
9 
9 
8 
8 
9 
8 
8 
8 

5 

7 

8 
8 
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clusters  modules  package 
stubs 

goto  statements 
comments 

exception  handlers 
task  coroutines 
other  prog  constructs 
importing  exporting  name 
data  encapsulation 
name  scoping 
name  visibility 
static  dynamic  nesting 
iteration 

conditional  statements 

recursion 

concurrency 

strong  typing 

type  conversion 

data  abstraction 

generics 

loop  invariants 

parameter  binding 

version  number 

other  prog  concepts 

A  enumeration  types 

Ada  user  defined  types 

Ada  subtypes 

Ada  derived  types 

Ada  real  types 

Ada  float  point  types 

Ada  fixed  pt  types 

Ada  record  types 

Ada  rec  types  discrim 

Ada  slices 

Ada  aggregates 

Ada  allocators 

Ada  access  types 

Ada  overloading 

Ada  packages 

Ada  private  types 

Ada  scope 

Ada  short  circuiting 

Ada  visibility 

Ada  tasking 

Ada  task  types 

Ada  rendezvous 

Ada  entries 

Ada  entry  families 

Ada  separate  compilation 

Ada  exceptions 

Ada  generic  prog  units 

Ada  instantiation 

Ada  elaboration 

Ada  context  spec 
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Ada  information  hiding 
Ada  mutual  recursion 
other  Ada  concepts 


110  1 
0  10  1 
0  0  0  0 


cluster3 


knowledge 


methodology 
PSL  PLA 
SADT 
SREM 
HI  PO 

Jackson  Design 
Structured  Design 
Warnier  Orr  Design 
N  S  Chapin  Chart 
Beamson  Tables 
Program  Design  language 
Structured  Programming 
Structured  Walkthroughs 
Top  Down  Design 
Top  Down  Testing 
Bottom  Up  Design 
3achman  Diagramming 
Entity  Diagrams 
Data  Abstraction 
other  methodology 
enumeration  types 
floating  point  types 
fixed  point  types 
user  defined  types 
pointers 
typed  pointers 
ranges 
records 

variant  records 
ooject  type  dels 
global  variables 
local  ••ariables 
formal  o.ttual  params 
reserved  words 
blocks 

case  statements 

if  then  else  statements 

loop  for  while  until 

exit  statements 

procedures 

functions 


used  frequently 
know  concept 

heard  of  used  moderately 

15  2  0 

0  3  0  0 

0  2  0  0 

3  8  11 

13  0  0 

0  4  8  5 

0  12  0 

2  110 
0  0  0  0 

13  8  5 

0  18  8 

0  4  8  5 

0  16  8 

0  4  8  5 

0  8  7  0 

110  0 
0  2  2  0 

3  2  5  0 

0  0  2  0 

13  7  1 

0  6  6  5 

0  4  5  8 

13  9  3 

0  3  7  6 

3  2  5  5 

0  4  9  3 

0  4  7  6 

2  3  6  3 

0  0  10  4 

0  1  5  11 

0  1  5  11 

0  2  5  8 

0  2  5  9 

0  3  4  9 

0  16  9 

0  0  7  9 

0  0  7  9 

0  2  9  5 

0  0  5  11 

0  0  7  9 
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return  statements 
clusters  modules  package 
stubs 

goto  statements 
comments 

exception  handlers 
task  coroutines 
other  prog  constructs 
importing  exporting  name 
data  encapsulation 
name  scoping 
name  visibility 
static  dynamic  nesting 
iteration 

conditional  statements 

recursion 

concurrency 

strong  typing 

type  conversion 

data  abstraction 

generics 

loop  invariants 

parameter  binding 

version  number 

other  prog  concepts 

A  enumeration  types 

Ada  user  defined  types 

Ada  subtypes 

Ada  derived  types 

Ada  real  types 

Ada  float  point  types 

Ada  fixed  pt  types 

Ada  record  types 

Ada  rec  types  discrim 

Ada  slices 

Ada  aggregates 

Ada  allocators 

Ada  access  types 

Ada  overloading 

Ada  packages 

Ada  private  types 

Ada  scope 

Ada  short  circuiting 

Ada  visibility 

Ada  tasking 

Ada  task  types 

Ada  rendezvous 

Ada  entries 

Ada  entry  families 

Ada  separate  compilation 

Ada  exceptions 

Ada  generic  prog  units 

Ada  instantiation 

Ada  elaboration 
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Ada  context  spec 

3 

4 

0 

0 

Ada  information  hiding 

2 

10 

0 

0 

Ada  mutual  recursion 

5 

5 

0 

0 

other  Ada  concepts 

cluster4 

0 

0 

0 

0 

knowledge 


know 

used 

concept 

frequently 

methodology 

heard  of 

used 

moderately 

PSL  PLA 

16 

20 

7 

0 

SADT 

5 

3 

7 

0 

SREM 

3 

8 

1 

1 

HI  PO 

16 

44 

26 

9 

Jackson  Design 

11 

10 

5 

6 

Structured  Design 

5 

13 

34 

71 

Warnier  Crr  Design 

13 

14 

2 

3 

N  S  Chapin  Chart 

13 

12 

6 

1 

Beamson  Tables 

3 

1 

1 

0 

Program  Design  language 

5 

32 

25 

51 

Structured  Programming 

0 

9 

30 

90 

Structured  Walkthroughs 

4 

35 

42 

37 

Top  Down  Design 

1 

8 

32 

86 

Top  Down  Testing 

4 

28 

37 

55 

Bottom  Up  Design 

6 

53 

39 

19 

Bachman  Diagramming 

6 

7 

1 

1 

Entity  Diagrams 

7 

6 

0 

1 

Data  Abstraction 

14 

34 

15 

10 

other  methodology 

0 

0 

0 

3 

enumeration  type? 

9 

26 

17 

18 

floating  point  types 

3 

22 

40 

61 

fixed  point  types 

2 

11 

27 

83 

user  defined  cypes 

6 

28 

34 

43 

pointers 

2 

16 

31 

74 

typed  pointers 

10 

26 

20 

34 

ranges 

5 

27 

28 

49 

records 

2 

19 

34 

70 

variant  records 

12 

29 

21 

28 

object  type  dels 

5 

27 

29 

47 

global  variables 

2 

7 

23 

96 

local  v_*iables 

2 

9 

20 

97 

formal  actual  params 

7 

7 

25 

70 

reserved  words 

3 

17 

25 

82 

blocks 

1 

17 

29 

70 

case  statements 

4 

12 

30 

77 

if  then  else  statements 

1 

7 

23 

98 

loop  for  while  until 

1 

9 

26 

93 

exit  statements 

1 

27 

35 

64 

procedures 

2 

8 

25 

94 
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functions 
return  statements 
clusters  modules  package 
stubs 

goto  statements 
comments 

exception  handlers 
task  coroutines 
other  prog  constructs 
importing  exporting  name 
data  encapsulation 
name  scoping 
name  visibility 
static  dynamic  nesting 
iteration 

conditional  statements 

recursion 

concurrency 

strong  typing 

type  conversion 

data  abstraction 

generics 

loop  invariants 

parameter  binding 

version  number 

other  prog  concepts 

A  enumeration  types 

Ada  user  defined  types 

Ada  subtypes 

Ada  derived  types 

Ada  real  types 

Ada  float  point  types 

Ada  fixed  pt  types 

Ada  record  types 

Ada  rec  types  discrim 

Ada  slices 

Ada  aggregates 

Ada  allocators 

Ada  access  types 

Ada  overloading 

Ada  packages 

Ada  private  types 

Ada  scope 

Ada  short  circuiting 

Ada  visibility 

Ada  tasking 

Ada  task  types 

Ada  rendezvous 

Ada  entries 

Ada  entry  families 

Ada  separate  compilation 

Ada  exceptions 

Ada  generic  prog  units 

Ada  instantiation 


1 

10 

31 

87 

2 

9 

21 

95 

6 

25 

32 

48 

3 

19 

33 

57 

0 

22 

36 

70 

0 

6 

17 

105 

6 

33 

29 

47 

9 

36 

27 

41 

0 

0 

0 

0 

12 

11 

5 

9 

17 

26 

21 

20 

14 

19 

9 

25 

14 

23 

6 

21 

22 

24 

15 

23 

3 

14 

33 

75 

3 

5 

25 

95 

1 

35 

45 

37 

7 

42 

28 

27 

9 

29 

17 

19 

9 

27 

30 

36 

20 

36 

15 

21 

15 

28 

15 

11 

19 

23 

16 

13 

19 

26 

14 

11 

8 

20 

27 

45 

0 

0 

0 

2 

15 

33 

7 

7 

14 

45 

8 

12 

20 

31 

7 

5 

23 

22 

7 

3 

9 

47 

13 

17 

7 

51 

13 

20 

5 

50 

9 

24 

12 

41 

11 

17 

20 

24 

3 

4 

13 

15 

6 

4 

15 

16 

2 

3 

14 

19 

2 

3 

15 

27 

3 

6 

12 

24 

3 

3 

10 

37 

6 

4 

10 

33 

5 

2 

9 

37 

4 

6 

10 

17 

2 

1 

13 

33 

6 

3 

17 
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